2024-04-24T01:40:19.020 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-24T01:40:19.020 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yingxin@teuthology --name yingxin-2024-04-24_01:32:34-crimson-rados-ci-yingxin-crimson-load-obc-new-1-distro-default-smithi --description crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} --archive /home/teuthworker/archive/yingxin-2024-04-24_01:32:34-crimson-rados-ci-yingxin-crimson-load-obc-new-1-distro-default-smithi/7671128 --verbose -- /home/teuthworker/archive/yingxin-2024-04-24_01:32:34-crimson-rados-ci-yingxin-crimson-load-obc-new-1-distro-default-smithi/7671128/orig.config.yaml 2024-04-24T01:40:19.052 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-24T01:40:19.138 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yingxin-2024-04-24_01:32:34-crimson-rados-ci-yingxin-crimson-load-obc-new-1-distro-default-smithi/7671128 branch: ci-yingxin-crimson-load-obc-new-1 description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} email: yingxin.cheng@intel.com first_in_suite: false job_id: '7671128' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yingxin-2024-04-24_01:32:34-crimson-rados-ci-yingxin-crimson-load-obc-new-1-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: ci-yingxin-crimson-load-obc-new-1 ceph: conf: client: debug ms: 1 global: enable experimental unrecoverable data corrupting features: crimson ms client mode: crc ms cluster mode: crc ms mon client mode: crc ms mon cluster mode: crc ms mon service mode: crc ms service mode: crc mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd pool default crimson: true osd: crimson alien thread cpu cores: 6-7 crimson osd obc lru size: 10 debug ms: 1 debug osd: 20 osd blocked scrub grace period: 3600 osd class default list: '*' osd class load list: '*' osd shutdown pgref assert: true osd.0: crimson seastar cpu cores: 0-2 osd.1: crimson seastar cpu cores: 3-5 osd.2: crimson seastar cpu cores: 0-2 osd.3: crimson seastar cpu cores: 3-5 flavor: crimson log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(POOL_APP_NOT_ENABLED\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) sha1: 424d8c4389b684b0a4d72510e1b4d398d8e6c8f4 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: crimson sha1: 424d8c4389b684b0a4d72510e1b4d398d8e6c8f4 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 workunit: branch: ci-yingxin-crimson-load-obc-new-1 env: CRIMSON_COMPAT: '1' sha1: 424d8c4389b684b0a4d72510e1b4d398d8e6c8f4 owner: scheduled_yingxin@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - osd.1 - client.0 - node-exporter.a - - mgr.x - osd.2 - osd.3 - client.1 - prometheus.a - node-exporter.b sha1: 424d8c4389b684b0a4d72510e1b4d398d8e6c8f4 sleep_before_teardown: 0 suite: crimson-rados suite_branch: ci-yingxin-crimson-load-obc-new-1 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_424d8c4389b684b0a4d72510e1b4d398d8e6c8f4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 424d8c4389b684b0a4d72510e1b4d398d8e6c8f4 targets: smithi057.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA8igD+egu8T5w2Cky7cCBwjAqBnNHNSpnSNyV6WyAMx0iMUvZgLRFoo6ZbJ6xbU/RNnU9Rezy3NvudRDTIevaA= smithi084.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMJdcvVV+6331hL+QGBTBKElA5Km24tJ7CBPfduku55yW3m7GIcWTm65BzeUaVhJkajXDrLuoDX1zvifGTc89D0= tasks: - install: null - ceph: conf: mon: mon min osdmap epochs: 50 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 paxos service trim min: 10 osd: debug monc: 20 flavor: crimson - workunit: clients: client.0: - rados/test.sh --crimson - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-24_01:32:34 tube: smithi user: yingxin verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-24T01:40:19.139 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_424d8c4389b684b0a4d72510e1b4d398d8e6c8f4/qa; will attempt to use it 2024-04-24T01:40:19.139 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_424d8c4389b684b0a4d72510e1b4d398d8e6c8f4/qa/tasks 2024-04-24T01:40:19.140 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-24T01:40:19.141 INFO:teuthology.task.internal:Checking packages... 2024-04-24T01:40:19.172 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'crimson' and ceph hash '424d8c4389b684b0a4d72510e1b4d398d8e6c8f4' 2024-04-24T01:40:19.172 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-24T01:40:19.172 INFO:teuthology.packaging:ref: None 2024-04-24T01:40:19.172 INFO:teuthology.packaging:tag: None 2024-04-24T01:40:19.172 INFO:teuthology.packaging:branch: ci-yingxin-crimson-load-obc-new-1 2024-04-24T01:40:19.172 INFO:teuthology.packaging:sha1: 424d8c4389b684b0a4d72510e1b4d398d8e6c8f4 2024-04-24T01:40:19.172 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&ref=ci-yingxin-crimson-load-obc-new-1 2024-04-24T01:40:19.320 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3227.g424d8c43 2024-04-24T01:40:19.321 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-24T01:40:19.329 INFO:teuthology.task.internal:no buildpackages task found 2024-04-24T01:40:19.330 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-24T01:40:19.350 INFO:teuthology.task.internal:Saving configuration 2024-04-24T01:40:19.366 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-24T01:40:19.375 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-24T01:40:19.400 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yingxin-2024-04-24_01:32:34-crimson-rados-ci-yingxin-crimson-load-obc-new-1-distro-default-smithi/7671128', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-24 01:35:10.612699', 'locked_by': 'scheduled_yingxin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA8igD+egu8T5w2Cky7cCBwjAqBnNHNSpnSNyV6WyAMx0iMUvZgLRFoo6ZbJ6xbU/RNnU9Rezy3NvudRDTIevaA='} 2024-04-24T01:40:19.420 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi084.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yingxin-2024-04-24_01:32:34-crimson-rados-ci-yingxin-crimson-load-obc-new-1-distro-default-smithi/7671128', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-24 01:35:10.611530', 'locked_by': 'scheduled_yingxin@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMJdcvVV+6331hL+QGBTBKElA5Km24tJ7CBPfduku55yW3m7GIcWTm65BzeUaVhJkajXDrLuoDX1zvifGTc89D0='} 2024-04-24T01:40:19.420 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-24T01:40:19.428 INFO:teuthology.task.internal:roles: ubuntu@smithi057.front.sepia.ceph.com - ['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'] 2024-04-24T01:40:19.429 INFO:teuthology.task.internal:roles: ubuntu@smithi084.front.sepia.ceph.com - ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-04-24T01:40:19.429 INFO:teuthology.run_tasks:Running task console_log... 2024-04-24T01:40:19.509 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9c5e515e50>, signals=[15]) 2024-04-24T01:40:19.510 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-24T01:40:19.518 INFO:teuthology.task.internal:Opening connections... 2024-04-24T01:40:19.519 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi057.front.sepia.ceph.com 2024-04-24T01:40:19.521 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T01:40:19.601 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi084.front.sepia.ceph.com 2024-04-24T01:40:19.602 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T01:40:19.676 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-24T01:40:19.689 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2024-04-24T01:40:19.708 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2024-04-24T01:40:19.708 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2024-04-24T01:40:19.766 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="CentOS Stream" 2024-04-24T01:40:19.766 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="9" 2024-04-24T01:40:19.766 INFO:teuthology.orchestra.run.smithi057.stdout:ID="centos" 2024-04-24T01:40:19.766 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="rhel fedora" 2024-04-24T01:40:19.766 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="9" 2024-04-24T01:40:19.766 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el9" 2024-04-24T01:40:19.766 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-24T01:40:19.766 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2024-04-24T01:40:19.766 INFO:teuthology.orchestra.run.smithi057.stdout:LOGO="fedora-logo-icon" 2024-04-24T01:40:19.766 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-24T01:40:19.766 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://centos.org/" 2024-04-24T01:40:19.767 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-24T01:40:19.767 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-24T01:40:19.767 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-24T01:40:19.767 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2024-04-24T01:40:19.795 DEBUG:teuthology.orchestra.run.smithi084:> uname -m 2024-04-24T01:40:19.813 INFO:teuthology.orchestra.run.smithi084.stdout:x86_64 2024-04-24T01:40:19.814 DEBUG:teuthology.orchestra.run.smithi084:> cat /etc/os-release 2024-04-24T01:40:19.871 INFO:teuthology.orchestra.run.smithi084.stdout:NAME="CentOS Stream" 2024-04-24T01:40:19.872 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION="9" 2024-04-24T01:40:19.872 INFO:teuthology.orchestra.run.smithi084.stdout:ID="centos" 2024-04-24T01:40:19.872 INFO:teuthology.orchestra.run.smithi084.stdout:ID_LIKE="rhel fedora" 2024-04-24T01:40:19.872 INFO:teuthology.orchestra.run.smithi084.stdout:VERSION_ID="9" 2024-04-24T01:40:19.872 INFO:teuthology.orchestra.run.smithi084.stdout:PLATFORM_ID="platform:el9" 2024-04-24T01:40:19.872 INFO:teuthology.orchestra.run.smithi084.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-24T01:40:19.872 INFO:teuthology.orchestra.run.smithi084.stdout:ANSI_COLOR="0;31" 2024-04-24T01:40:19.872 INFO:teuthology.orchestra.run.smithi084.stdout:LOGO="fedora-logo-icon" 2024-04-24T01:40:19.872 INFO:teuthology.orchestra.run.smithi084.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-24T01:40:19.872 INFO:teuthology.orchestra.run.smithi084.stdout:HOME_URL="https://centos.org/" 2024-04-24T01:40:19.872 INFO:teuthology.orchestra.run.smithi084.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-24T01:40:19.872 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-24T01:40:19.872 INFO:teuthology.orchestra.run.smithi084.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-24T01:40:19.873 INFO:teuthology.lock.ops:Updating smithi084.front.sepia.ceph.com on lock server 2024-04-24T01:40:19.895 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-24T01:40:19.904 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-24T01:40:19.911 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-24T01:40:19.912 DEBUG:teuthology.orchestra.run.smithi057:> test '!' -e /home/ubuntu/cephtest 2024-04-24T01:40:19.914 DEBUG:teuthology.orchestra.run.smithi084:> test '!' -e /home/ubuntu/cephtest 2024-04-24T01:40:19.930 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-24T01:40:19.937 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-24T01:40:19.938 DEBUG:teuthology.orchestra.run.smithi057:> test -z $(ls -A /var/lib/ceph) 2024-04-24T01:40:19.971 DEBUG:teuthology.orchestra.run.smithi084:> test -z $(ls -A /var/lib/ceph) 2024-04-24T01:40:20.071 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-24T01:40:20.124 INFO:teuthology.run_tasks:Running task kernel... 2024-04-24T01:40:20.140 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-24T01:40:20.140 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-24T01:40:20.140 DEBUG:teuthology.orchestra.run.smithi057:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-24T01:40:20.141 DEBUG:teuthology.orchestra.run.smithi084:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-24T01:40:20.157 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T01:40:20.158 DEBUG:teuthology.orchestra.run.smithi084:> uname -r 2024-04-24T01:40:20.158 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T01:40:20.159 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2024-04-24T01:40:20.216 INFO:teuthology.orchestra.run.smithi084.stdout:5.14.0-437.el9.x86_64 2024-04-24T01:40:20.216 INFO:teuthology.task.kernel:Running kernel on smithi084: 5.14.0-437.el9.x86_64 2024-04-24T01:40:20.216 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum install -y kernel 2024-04-24T01:40:20.217 INFO:teuthology.orchestra.run.smithi057.stdout:5.14.0-437.el9.x86_64 2024-04-24T01:40:20.217 INFO:teuthology.task.kernel:Running kernel on smithi057: 5.14.0-437.el9.x86_64 2024-04-24T01:40:20.218 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum install -y kernel 2024-04-24T01:40:22.963 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - BaseOS 6.6 MB/s | 8.0 MB 00:01 2024-04-24T01:40:23.690 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.0 MB 00:01 2024-04-24T01:40:25.364 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - AppStream 15 MB/s | 19 MB 00:01 2024-04-24T01:40:25.665 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-04-24T01:40:30.832 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.2 MB 00:01 2024-04-24T01:40:31.490 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.2 MB 00:02 2024-04-24T01:40:32.567 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 16 kB 00:00 2024-04-24T01:40:33.636 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 22 MB/s | 21 MB 00:00 2024-04-24T01:40:34.409 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - Extras packages 9.8 kB/s | 16 kB 00:01 2024-04-24T01:40:38.686 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-24T01:40:40.547 INFO:teuthology.orchestra.run.smithi084.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-24T01:40:40.548 INFO:teuthology.orchestra.run.smithi084.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-24T01:40:40.636 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-24T01:40:40.637 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-04-24T01:40:40.637 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-24T01:40:40.749 DEBUG:teuthology.orchestra.run.smithi084:> echo no | sudo yum reinstall kernel || true 2024-04-24T01:40:41.294 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:00:03 ago on Wed 24 Apr 2024 01:40:38 AM UTC. 2024-04-24T01:40:41.425 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-24T01:40:41.438 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:40:41.438 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2024-04-24T01:40:41.438 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:40:41.438 INFO:teuthology.orchestra.run.smithi084.stdout:Reinstalling: 2024-04-24T01:40:41.438 INFO:teuthology.orchestra.run.smithi084.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-24T01:40:41.438 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:40:41.438 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-24T01:40:41.438 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:40:41.439 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:40:41.439 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 255 k 2024-04-24T01:40:41.439 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 0 2024-04-24T01:40:41.439 INFO:teuthology.orchestra.run.smithi084.stderr:Operation aborted. 2024-04-24T01:40:41.498 INFO:teuthology.orchestra.run.smithi084.stdout:Is this ok [y/N]: 2024-04-24T01:40:41.498 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum reinstall -y kernel || true 2024-04-24T01:40:41.989 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:00:03 ago on Wed 24 Apr 2024 01:40:38 AM UTC. 2024-04-24T01:40:42.104 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-24T01:40:42.105 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:40:42.105 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2024-04-24T01:40:42.105 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:40:42.105 INFO:teuthology.orchestra.run.smithi084.stdout:Reinstalling: 2024-04-24T01:40:42.106 INFO:teuthology.orchestra.run.smithi084.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-24T01:40:42.106 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:40:42.106 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-24T01:40:42.106 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:40:42.106 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:40:42.106 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 255 k 2024-04-24T01:40:42.106 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 0 2024-04-24T01:40:42.106 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-24T01:40:42.593 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.1 MB/s | 255 kB 00:00 2024-04-24T01:40:42.594 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:40:42.594 INFO:teuthology.orchestra.run.smithi084.stdout:Total 523 kB/s | 255 kB 00:00 2024-04-24T01:40:42.614 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-24T01:40:42.795 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-24T01:40:42.795 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-24T01:40:42.800 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-24T01:40:42.800 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-24T01:40:42.947 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-24T01:40:43.036 INFO:teuthology.orchestra.run.smithi084.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-24T01:40:43.036 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-24T01:40:43.752 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-24T01:40:43.753 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-24T01:40:44.387 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-24T01:40:44.387 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:40:44.387 INFO:teuthology.orchestra.run.smithi084.stdout:Reinstalled: 2024-04-24T01:40:44.387 INFO:teuthology.orchestra.run.smithi084.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-24T01:40:44.387 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:40:44.388 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-24T01:40:44.571 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q kernel | sort -rV | head -n 1 2024-04-24T01:40:44.617 INFO:teuthology.orchestra.run.smithi084.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-24T01:40:44.618 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-24T01:40:44.618 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-24T01:40:44.618 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-04-24T01:40:44.618 DEBUG:teuthology.orchestra.run.smithi084:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-24T01:40:44.652 INFO:teuthology.orchestra.run.smithi084.stdout:ttyS1 2024-04-24T01:40:44.674 DEBUG:teuthology.parallel:result is None 2024-04-24T01:40:46.432 INFO:teuthology.orchestra.run.smithi057.stdout:Extra Packages for Enterprise Linux 1.8 MB/s | 21 MB 00:11 2024-04-24T01:40:51.632 INFO:teuthology.orchestra.run.smithi057.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-04-24T01:40:53.580 INFO:teuthology.orchestra.run.smithi057.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-24T01:40:53.580 INFO:teuthology.orchestra.run.smithi057.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-24T01:40:53.682 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-24T01:40:53.683 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-04-24T01:40:53.683 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-24T01:40:53.797 DEBUG:teuthology.orchestra.run.smithi057:> echo no | sudo yum reinstall kernel || true 2024-04-24T01:40:54.317 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:00:03 ago on Wed 24 Apr 2024 01:40:51 AM UTC. 2024-04-24T01:40:54.448 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-24T01:40:54.459 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:40:54.459 INFO:teuthology.orchestra.run.smithi057.stdout: Package Architecture Version Repository Size 2024-04-24T01:40:54.459 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:40:54.459 INFO:teuthology.orchestra.run.smithi057.stdout:Reinstalling: 2024-04-24T01:40:54.459 INFO:teuthology.orchestra.run.smithi057.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-24T01:40:54.460 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:40:54.460 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-24T01:40:54.460 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:40:54.460 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:40:54.460 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 255 k 2024-04-24T01:40:54.460 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 0 2024-04-24T01:40:54.460 INFO:teuthology.orchestra.run.smithi057.stderr:Operation aborted. 2024-04-24T01:40:54.522 INFO:teuthology.orchestra.run.smithi057.stdout:Is this ok [y/N]: 2024-04-24T01:40:54.522 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum reinstall -y kernel || true 2024-04-24T01:40:55.036 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:00:04 ago on Wed 24 Apr 2024 01:40:51 AM UTC. 2024-04-24T01:40:55.157 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-24T01:40:55.158 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:40:55.158 INFO:teuthology.orchestra.run.smithi057.stdout: Package Architecture Version Repository Size 2024-04-24T01:40:55.158 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:40:55.158 INFO:teuthology.orchestra.run.smithi057.stdout:Reinstalling: 2024-04-24T01:40:55.158 INFO:teuthology.orchestra.run.smithi057.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-24T01:40:55.158 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:40:55.158 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-24T01:40:55.158 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:40:55.158 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:40:55.159 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 255 k 2024-04-24T01:40:55.159 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 0 2024-04-24T01:40:55.159 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-04-24T01:40:55.642 INFO:teuthology.orchestra.run.smithi057.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.2 MB/s | 255 kB 00:00 2024-04-24T01:40:55.643 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:40:55.643 INFO:teuthology.orchestra.run.smithi057.stdout:Total 526 kB/s | 255 kB 00:00 2024-04-24T01:40:55.657 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-04-24T01:40:55.860 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-04-24T01:40:55.860 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-04-24T01:40:55.865 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-04-24T01:40:55.866 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-04-24T01:40:56.028 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-04-24T01:40:56.110 INFO:teuthology.orchestra.run.smithi057.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-24T01:40:56.110 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-24T01:40:56.789 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-24T01:40:56.789 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-24T01:40:57.463 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-24T01:40:57.463 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:40:57.463 INFO:teuthology.orchestra.run.smithi057.stdout:Reinstalled: 2024-04-24T01:40:57.463 INFO:teuthology.orchestra.run.smithi057.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-24T01:40:57.463 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:40:57.464 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-24T01:40:57.639 DEBUG:teuthology.orchestra.run.smithi057:> rpm -q kernel | sort -rV | head -n 1 2024-04-24T01:40:57.687 INFO:teuthology.orchestra.run.smithi057.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-24T01:40:57.687 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-24T01:40:57.687 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-24T01:40:57.687 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-24T01:40:57.687 DEBUG:teuthology.orchestra.run.smithi057:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-24T01:40:57.724 INFO:teuthology.orchestra.run.smithi057.stdout:ttyS1 2024-04-24T01:40:57.745 DEBUG:teuthology.parallel:result is None 2024-04-24T01:40:57.746 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-24T01:40:57.755 INFO:teuthology.task.internal:Creating test directory... 2024-04-24T01:40:57.755 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-24T01:40:57.788 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-24T01:40:57.806 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-24T01:40:57.814 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-24T01:40:57.824 INFO:teuthology.task.internal:Creating archive directory... 2024-04-24T01:40:57.824 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-24T01:40:57.843 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-24T01:40:57.882 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-24T01:40:57.890 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-24T01:40:57.890 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-24T01:40:57.909 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-24T01:40:57.946 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T01:40:57.956 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T01:40:57.969 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T01:40:57.980 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T01:40:57.982 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-24T01:40:57.989 INFO:teuthology.task.internal:Configuring sudo... 2024-04-24T01:40:57.989 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-24T01:40:58.000 DEBUG:teuthology.orchestra.run.smithi084:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-24T01:40:58.025 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-24T01:40:58.035 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-24T01:40:58.036 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-24T01:40:58.065 DEBUG:teuthology.orchestra.run.smithi084:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-24T01:40:58.081 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T01:40:58.162 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T01:40:58.206 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T01:40:58.289 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T01:40:58.329 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T01:40:58.329 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-24T01:40:58.393 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T01:40:58.439 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T01:40:58.484 DEBUG:teuthology.orchestra.run.smithi084:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T01:40:58.570 DEBUG:teuthology.orchestra.run.smithi084:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T01:40:58.608 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-24T01:40:58.608 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-24T01:40:58.674 DEBUG:teuthology.orchestra.run.smithi057:> sudo service rsyslog restart 2024-04-24T01:40:58.677 DEBUG:teuthology.orchestra.run.smithi084:> sudo service rsyslog restart 2024-04-24T01:40:58.709 INFO:teuthology.orchestra.run.smithi057.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-24T01:40:58.757 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-24T01:40:59.231 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-24T01:40:59.239 INFO:teuthology.task.internal:Starting timer... 2024-04-24T01:40:59.239 INFO:teuthology.run_tasks:Running task pcp... 2024-04-24T01:40:59.251 INFO:teuthology.run_tasks:Running task selinux... 2024-04-24T01:40:59.261 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-24T01:40:59.261 DEBUG:teuthology.orchestra.run.smithi057:> sudo service auditd rotate 2024-04-24T01:40:59.327 INFO:teuthology.orchestra.run.smithi057.stdout:Rotating logs: 2024-04-24T01:40:59.329 DEBUG:teuthology.orchestra.run.smithi084:> sudo service auditd rotate 2024-04-24T01:40:59.389 INFO:teuthology.orchestra.run.smithi084.stdout:Rotating logs: 2024-04-24T01:40:59.391 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-24T01:40:59.391 DEBUG:teuthology.orchestra.run.smithi057:> /usr/sbin/getenforce 2024-04-24T01:40:59.424 INFO:teuthology.orchestra.run.smithi057.stdout:Permissive 2024-04-24T01:40:59.424 DEBUG:teuthology.orchestra.run.smithi084:> /usr/sbin/getenforce 2024-04-24T01:40:59.452 INFO:teuthology.orchestra.run.smithi084.stdout:Permissive 2024-04-24T01:40:59.452 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi057.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi084.front.sepia.ceph.com': 'permissive'} 2024-04-24T01:40:59.452 DEBUG:teuthology.orchestra.run.smithi057:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-24T01:40:59.491 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T01:40:59.491 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-24T01:40:59.516 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T01:40:59.517 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-24T01:40:59.517 DEBUG:teuthology.orchestra.run.smithi057:> sudo /usr/sbin/setenforce permissive 2024-04-24T01:40:59.556 DEBUG:teuthology.orchestra.run.smithi084:> sudo /usr/sbin/setenforce permissive 2024-04-24T01:40:59.588 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-24T01:40:59.598 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-24T01:40:59.614 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-24T01:40:59.616 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi057.front.sepia.ceph.com,smithi084.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-24T01:44:31.827 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi057.front.sepia.ceph.com'), Remote(name='ubuntu@smithi084.front.sepia.ceph.com')] 2024-04-24T01:44:31.829 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-24T01:44:31.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T01:44:31.907 DEBUG:teuthology.orchestra.run.smithi057:> true 2024-04-24T01:44:31.994 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-04-24T01:44:31.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-04-24T01:44:31.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi084.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T01:44:32.066 DEBUG:teuthology.orchestra.run.smithi084:> true 2024-04-24T01:44:32.152 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi084.front.sepia.ceph.com' 2024-04-24T01:44:32.153 INFO:teuthology.run_tasks:Running task clock... 2024-04-24T01:44:32.166 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-24T01:44:32.167 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-24T01:44:32.167 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T01:44:32.169 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-24T01:44:32.170 DEBUG:teuthology.orchestra.run.smithi084:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T01:44:32.197 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-24T01:44:32.211 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-24T01:44:32.219 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-24T01:44:32.232 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-24T01:44:32.236 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: ntpd: command not found 2024-04-24T01:44:32.247 INFO:teuthology.orchestra.run.smithi057.stdout:506 Cannot talk to daemon 2024-04-24T01:44:32.254 INFO:teuthology.orchestra.run.smithi084.stderr:sudo: ntpd: command not found 2024-04-24T01:44:32.260 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-24T01:44:32.264 INFO:teuthology.orchestra.run.smithi084.stdout:506 Cannot talk to daemon 2024-04-24T01:44:32.274 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-24T01:44:32.278 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-24T01:44:32.291 INFO:teuthology.orchestra.run.smithi084.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-24T01:44:32.332 INFO:teuthology.orchestra.run.smithi057.stderr:bash: line 1: ntpq: command not found 2024-04-24T01:44:32.336 INFO:teuthology.orchestra.run.smithi057.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-24T01:44:32.336 INFO:teuthology.orchestra.run.smithi057.stdout:=============================================================================== 2024-04-24T01:44:32.336 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T01:44:32.336 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T01:44:32.336 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T01:44:32.336 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T01:44:32.344 INFO:teuthology.orchestra.run.smithi084.stderr:bash: line 1: ntpq: command not found 2024-04-24T01:44:32.347 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-24T01:44:32.347 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2024-04-24T01:44:32.347 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T01:44:32.348 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T01:44:32.348 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T01:44:32.348 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T01:44:32.348 INFO:teuthology.run_tasks:Running task install... 2024-04-24T01:44:32.356 DEBUG:teuthology.task.install:project ceph 2024-04-24T01:44:32.356 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'crimson', 'sha1': '424d8c4389b684b0a4d72510e1b4d398d8e6c8f4'}} 2024-04-24T01:44:32.356 DEBUG:teuthology.task.install:config {'flavor': 'crimson', 'sha1': '424d8c4389b684b0a4d72510e1b4d398d8e6c8f4'} 2024-04-24T01:44:32.356 INFO:teuthology.task.install:Using flavor: crimson 2024-04-24T01:44:32.362 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-24T01:44:32.362 INFO:teuthology.task.install:extra packages: [] 2024-04-24T01:44:32.362 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '424d8c4389b684b0a4d72510e1b4d398d8e6c8f4', 'tag': None, 'wait_for_package': False} 2024-04-24T01:44:32.363 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=424d8c4389b684b0a4d72510e1b4d398d8e6c8f4 2024-04-24T01:44:32.365 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'crimson', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '424d8c4389b684b0a4d72510e1b4d398d8e6c8f4', 'tag': None, 'wait_for_package': False} 2024-04-24T01:44:32.365 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=424d8c4389b684b0a4d72510e1b4d398d8e6c8f4 2024-04-24T01:44:32.508 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/ci-yingxin-crimson-load-obc-new-1/424d8c4389b684b0a4d72510e1b4d398d8e6c8f4/centos/9/flavors/crimson/ 2024-04-24T01:44:32.508 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3227.g424d8c43 2024-04-24T01:44:32.607 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/ci-yingxin-crimson-load-obc-new-1/424d8c4389b684b0a4d72510e1b4d398d8e6c8f4/centos/9/flavors/crimson/ 2024-04-24T01:44:32.607 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3227.g424d8c43 2024-04-24T01:44:32.738 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/ci-yingxin-crimson-load-obc-new-1/424d8c4389b684b0a4d72510e1b4d398d8e6c8f4/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/ci-yingxin-crimson-load-obc-new-1/424d8c4389b684b0a4d72510e1b4d398d8e6c8f4/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/ci-yingxin-crimson-load-obc-new-1/424d8c4389b684b0a4d72510e1b4d398d8e6c8f4/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-24T01:44:32.738 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T01:44:32.738 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-24T01:44:32.765 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-24T01:44:32.765 DEBUG:teuthology.orchestra.run.smithi057:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/424d8c4389b684b0a4d72510e1b4d398d8e6c8f4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-24T01:44:32.774 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/ci-yingxin-crimson-load-obc-new-1/424d8c4389b684b0a4d72510e1b4d398d8e6c8f4/centos/9/flavors/crimson/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/ci-yingxin-crimson-load-obc-new-1/424d8c4389b684b0a4d72510e1b4d398d8e6c8f4/centos/9/flavors/crimson/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/ci-yingxin-crimson-load-obc-new-1/424d8c4389b684b0a4d72510e1b4d398d8e6c8f4/centos/9/flavors/crimson/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-24T01:44:32.774 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-24T01:44:32.774 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-24T01:44:32.800 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-04-24T01:44:32.800 DEBUG:teuthology.orchestra.run.smithi084:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/424d8c4389b684b0a4d72510e1b4d398d8e6c8f4/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-24T01:44:32.831 DEBUG:teuthology.orchestra.run.smithi057:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-24T01:44:32.864 DEBUG:teuthology.orchestra.run.smithi084:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-24T01:44:32.907 DEBUG:teuthology.orchestra.run.smithi057:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-24T01:44:32.938 DEBUG:teuthology.orchestra.run.smithi084:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-24T01:44:32.971 INFO:teuthology.orchestra.run.smithi057.stdout:check_obsoletes = 1 2024-04-24T01:44:32.973 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum clean all 2024-04-24T01:44:33.000 INFO:teuthology.orchestra.run.smithi084.stdout:check_obsoletes = 1 2024-04-24T01:44:33.002 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum clean all 2024-04-24T01:44:33.208 INFO:teuthology.orchestra.run.smithi057.stdout:48 files removed 2024-04-24T01:44:33.226 INFO:teuthology.orchestra.run.smithi084.stdout:48 files removed 2024-04-24T01:44:33.235 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-radosgw 2024-04-24T01:44:33.254 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-radosgw 2024-04-24T01:44:34.005 INFO:teuthology.orchestra.run.smithi057.stdout:ceph packages for x86_64 175 kB/s | 87 kB 00:00 2024-04-24T01:44:34.009 INFO:teuthology.orchestra.run.smithi084.stdout:ceph packages for x86_64 175 kB/s | 87 kB 00:00 2024-04-24T01:44:34.419 INFO:teuthology.orchestra.run.smithi084.stdout:ceph noarch packages 32 kB/s | 12 kB 00:00 2024-04-24T01:44:34.455 INFO:teuthology.orchestra.run.smithi057.stdout:ceph noarch packages 29 kB/s | 12 kB 00:00 2024-04-24T01:44:34.769 INFO:teuthology.orchestra.run.smithi084.stdout:ceph source packages 6.5 kB/s | 2.0 kB 00:00 2024-04-24T01:44:34.831 INFO:teuthology.orchestra.run.smithi057.stdout:ceph source packages 6.0 kB/s | 2.0 kB 00:00 2024-04-24T01:44:35.361 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.0 MB 00:00 2024-04-24T01:44:36.806 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - BaseOS 4.1 MB/s | 8.0 MB 00:01 2024-04-24T01:44:55.922 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 19 MB 00:18 2024-04-24T01:44:59.257 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - AppStream 853 kB/s | 19 MB 00:22 2024-04-24T01:45:03.391 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-24T01:45:05.560 INFO:teuthology.orchestra.run.smithi084.stdout:CentOS Stream 9 - Extras packages 16 kB/s | 16 kB 00:01 2024-04-24T01:45:07.794 INFO:teuthology.orchestra.run.smithi084.stdout:Extra Packages for Enterprise Linux 9.9 MB/s | 21 MB 00:02 2024-04-24T01:45:07.938 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - CRB 759 kB/s | 6.2 MB 00:08 2024-04-24T01:45:11.125 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - Extras packages 8.0 kB/s | 16 kB 00:02 2024-04-24T01:45:12.927 INFO:teuthology.orchestra.run.smithi084.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-04-24T01:45:14.099 INFO:teuthology.orchestra.run.smithi057.stdout:Extra Packages for Enterprise Linux 7.4 MB/s | 21 MB 00:02 2024-04-24T01:45:15.071 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-24T01:45:15.073 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:45:15.073 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-04-24T01:45:15.073 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:45:15.073 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-24T01:45:15.073 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 10 M 2024-04-24T01:45:15.073 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrading: 2024-04-24T01:45:15.074 INFO:teuthology.orchestra.run.smithi084.stdout: librados2 x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 3.4 M 2024-04-24T01:45:15.074 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1 x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 3.7 M 2024-04-24T01:45:15.074 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-04-24T01:45:15.074 INFO:teuthology.orchestra.run.smithi084.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-24T01:45:15.074 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 5.9 M 2024-04-24T01:45:15.074 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 19 M 2024-04-24T01:45:15.074 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 25 k 2024-04-24T01:45:15.074 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-24T01:45:15.074 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-24T01:45:15.074 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-24T01:45:15.074 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2 x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 796 k 2024-04-24T01:45:15.074 INFO:teuthology.orchestra.run.smithi084.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-24T01:45:15.074 INFO:teuthology.orchestra.run.smithi084.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-24T01:45:15.075 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-24T01:45:15.075 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1 x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 548 k 2024-04-24T01:45:15.075 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-24T01:45:15.075 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2 x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 5.2 M 2024-04-24T01:45:15.075 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-24T01:45:15.075 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-24T01:45:15.075 INFO:teuthology.orchestra.run.smithi084.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-24T01:45:15.075 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 45 k 2024-04-24T01:45:15.075 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 135 k 2024-04-24T01:45:15.075 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 159 k 2024-04-24T01:45:15.075 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-24T01:45:15.075 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 315 k 2024-04-24T01:45:15.075 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 293 k 2024-04-24T01:45:15.076 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 99 k 2024-04-24T01:45:15.076 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-24T01:45:15.076 INFO:teuthology.orchestra.run.smithi084.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-24T01:45:15.076 INFO:teuthology.orchestra.run.smithi084.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-24T01:45:15.076 INFO:teuthology.orchestra.run.smithi084.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-24T01:45:15.076 INFO:teuthology.orchestra.run.smithi084.stdout:Installing weak dependencies: 2024-04-24T01:45:15.076 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-24T01:45:15.076 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:45:15.076 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-24T01:45:15.076 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:45:15.076 INFO:teuthology.orchestra.run.smithi084.stdout:Install 30 Packages 2024-04-24T01:45:15.076 INFO:teuthology.orchestra.run.smithi084.stdout:Upgrade 2 Packages 2024-04-24T01:45:15.076 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:45:15.077 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 59 M 2024-04-24T01:45:15.077 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-24T01:45:16.177 INFO:teuthology.orchestra.run.smithi084.stdout:(1/32): ceph-radosgw-19.0.0-3227.g424d8c43.el9. 12 MB/s | 10 MB 00:00 2024-04-24T01:45:16.228 INFO:teuthology.orchestra.run.smithi084.stdout:(2/32): ceph-selinux-19.0.0-3227.g424d8c43.el9. 503 kB/s | 25 kB 00:00 2024-04-24T01:45:16.369 INFO:teuthology.orchestra.run.smithi084.stdout:(3/32): libcephfs2-19.0.0-3227.g424d8c43.el9.x8 5.5 MB/s | 796 kB 00:00 2024-04-24T01:45:16.495 INFO:teuthology.orchestra.run.smithi084.stdout:(4/32): libradosstriper1-19.0.0-3227.g424d8c43. 4.3 MB/s | 548 kB 00:00 2024-04-24T01:45:16.812 INFO:teuthology.orchestra.run.smithi084.stdout:(5/32): librgw2-19.0.0-3227.g424d8c43.el9.x86_6 17 MB/s | 5.2 MB 00:00 2024-04-24T01:45:16.912 INFO:teuthology.orchestra.run.smithi084.stdout:(6/32): ceph-base-19.0.0-3227.g424d8c43.el9.x86 3.7 MB/s | 5.9 MB 00:01 2024-04-24T01:45:16.937 INFO:teuthology.orchestra.run.smithi084.stdout:(7/32): python3-ceph-argparse-19.0.0-3227.g424d 360 kB/s | 45 kB 00:00 2024-04-24T01:45:17.021 INFO:teuthology.orchestra.run.smithi084.stdout:(8/32): python3-ceph-common-19.0.0-3227.g424d8c 1.2 MB/s | 135 kB 00:00 2024-04-24T01:45:17.046 INFO:teuthology.orchestra.run.smithi084.stdout:(9/32): python3-cephfs-19.0.0-3227.g424d8c43.el 1.4 MB/s | 159 kB 00:00 2024-04-24T01:45:17.138 INFO:teuthology.orchestra.run.smithi084.stdout:(10/32): python3-rados-19.0.0-3227.g424d8c43.el 2.6 MB/s | 315 kB 00:00 2024-04-24T01:45:17.163 INFO:teuthology.orchestra.run.smithi084.stdout:(11/32): python3-rbd-19.0.0-3227.g424d8c43.el9. 2.4 MB/s | 293 kB 00:00 2024-04-24T01:45:17.263 INFO:teuthology.orchestra.run.smithi084.stdout:(12/32): python3-rgw-19.0.0-3227.g424d8c43.el9. 794 kB/s | 99 kB 00:00 2024-04-24T01:45:17.455 INFO:teuthology.orchestra.run.smithi084.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 366 kB/s | 107 kB 00:00 2024-04-24T01:45:17.564 INFO:teuthology.orchestra.run.smithi084.stdout:(14/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-04-24T01:45:17.623 INFO:teuthology.orchestra.run.smithi084.stdout:(15/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 446 kB/s | 160 kB 00:00 2024-04-24T01:45:17.756 INFO:teuthology.orchestra.run.smithi084.stdout:(16/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-04-24T01:45:17.823 INFO:teuthology.orchestra.run.smithi084.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 634 kB/s | 42 kB 00:00 2024-04-24T01:45:17.857 INFO:teuthology.orchestra.run.smithi084.stdout:(18/32): librdkafka-1.6.1-102.el9.x86_64.rpm 2.2 MB/s | 662 kB 00:00 2024-04-24T01:45:17.890 INFO:teuthology.orchestra.run.smithi084.stdout:(19/32): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-04-24T01:45:17.916 INFO:teuthology.orchestra.run.smithi084.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 612 kB/s | 36 kB 00:00 2024-04-24T01:45:17.949 INFO:teuthology.orchestra.run.smithi084.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 809 kB/s | 47 kB 00:00 2024-04-24T01:45:18.224 INFO:teuthology.orchestra.run.smithi084.stdout:(22/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.0 MB/s | 309 kB 00:00 2024-04-24T01:45:18.292 INFO:teuthology.orchestra.run.smithi084.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 389 kB/s | 26 kB 00:00 2024-04-24T01:45:18.358 INFO:teuthology.orchestra.run.smithi084.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 730 kB/s | 49 kB 00:00 2024-04-24T01:45:18.425 INFO:teuthology.orchestra.run.smithi084.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-04-24T01:45:18.826 INFO:teuthology.orchestra.run.smithi084.stdout:(26/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.0 MB/s | 838 kB 00:00 2024-04-24T01:45:18.959 INFO:teuthology.orchestra.run.smithi084.stdout:(27/32): re2-20211101-3.el9.x86_64.rpm 1.4 MB/s | 192 kB 00:00 2024-04-24T01:45:19.315 INFO:teuthology.orchestra.run.smithi057.stdout:lab-extras 42 kB/s | 1.7 kB 00:00 2024-04-24T01:45:19.434 INFO:teuthology.orchestra.run.smithi084.stdout:(28/32): libarrow-9.0.0-10.el9.x86_64.rpm 3.0 MB/s | 4.4 MB 00:01 2024-04-24T01:45:19.468 INFO:teuthology.orchestra.run.smithi084.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 3.1 MB/s | 1.6 MB 00:00 2024-04-24T01:45:19.877 INFO:teuthology.orchestra.run.smithi084.stdout:(30/32): ceph-common-19.0.0-3227.g424d8c43.el9. 4.3 MB/s | 19 MB 00:04 2024-04-24T01:45:19.943 INFO:teuthology.orchestra.run.smithi084.stdout:(31/32): librbd1-19.0.0-3227.g424d8c43.el9.x86_ 7.7 MB/s | 3.7 MB 00:00 2024-04-24T01:45:20.135 INFO:teuthology.orchestra.run.smithi084.stdout:(32/32): librados2-19.0.0-3227.g424d8c43.el9.x8 4.9 MB/s | 3.4 MB 00:00 2024-04-24T01:45:20.139 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:45:20.139 INFO:teuthology.orchestra.run.smithi084.stdout:Total 12 MB/s | 59 MB 00:05 2024-04-24T01:45:20.242 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-24T01:45:20.278 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-24T01:45:20.278 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-24T01:45:20.744 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-24T01:45:20.744 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-24T01:45:21.527 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-24T01:45:21.529 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:45:21.529 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-04-24T01:45:21.529 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:45:21.530 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-04-24T01:45:21.530 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 10 M 2024-04-24T01:45:21.530 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrading: 2024-04-24T01:45:21.530 INFO:teuthology.orchestra.run.smithi057.stdout: librados2 x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 3.4 M 2024-04-24T01:45:21.530 INFO:teuthology.orchestra.run.smithi057.stdout: librbd1 x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 3.7 M 2024-04-24T01:45:21.530 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-04-24T01:45:21.530 INFO:teuthology.orchestra.run.smithi057.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-24T01:45:21.530 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 5.9 M 2024-04-24T01:45:21.530 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 19 M 2024-04-24T01:45:21.530 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-selinux x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 25 k 2024-04-24T01:45:21.530 INFO:teuthology.orchestra.run.smithi057.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-24T01:45:21.530 INFO:teuthology.orchestra.run.smithi057.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-24T01:45:21.530 INFO:teuthology.orchestra.run.smithi057.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-24T01:45:21.531 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2 x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 796 k 2024-04-24T01:45:21.531 INFO:teuthology.orchestra.run.smithi057.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-24T01:45:21.531 INFO:teuthology.orchestra.run.smithi057.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-24T01:45:21.531 INFO:teuthology.orchestra.run.smithi057.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-24T01:45:21.531 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1 x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 548 k 2024-04-24T01:45:21.531 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-24T01:45:21.531 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2 x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 5.2 M 2024-04-24T01:45:21.531 INFO:teuthology.orchestra.run.smithi057.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-24T01:45:21.531 INFO:teuthology.orchestra.run.smithi057.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-24T01:45:21.531 INFO:teuthology.orchestra.run.smithi057.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-24T01:45:21.531 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 45 k 2024-04-24T01:45:21.531 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 135 k 2024-04-24T01:45:21.531 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 159 k 2024-04-24T01:45:21.531 INFO:teuthology.orchestra.run.smithi057.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-24T01:45:21.532 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 315 k 2024-04-24T01:45:21.532 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 293 k 2024-04-24T01:45:21.532 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 99 k 2024-04-24T01:45:21.532 INFO:teuthology.orchestra.run.smithi057.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-24T01:45:21.532 INFO:teuthology.orchestra.run.smithi057.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-24T01:45:21.532 INFO:teuthology.orchestra.run.smithi057.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-24T01:45:21.532 INFO:teuthology.orchestra.run.smithi057.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-24T01:45:21.532 INFO:teuthology.orchestra.run.smithi057.stdout:Installing weak dependencies: 2024-04-24T01:45:21.532 INFO:teuthology.orchestra.run.smithi057.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-24T01:45:21.532 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:45:21.532 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-24T01:45:21.532 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:45:21.532 INFO:teuthology.orchestra.run.smithi057.stdout:Install 30 Packages 2024-04-24T01:45:21.532 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrade 2 Packages 2024-04-24T01:45:21.532 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:45:21.533 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 59 M 2024-04-24T01:45:21.533 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-04-24T01:45:22.209 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-24T01:45:22.713 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-24T01:45:22.758 INFO:teuthology.orchestra.run.smithi057.stdout:(1/32): ceph-base-19.0.0-3227.g424d8c43.el9.x86 7.4 MB/s | 5.9 MB 00:00 2024-04-24T01:45:22.763 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librados2-2:19.0.0-3227.g424d8c43.el9.x86_64 2/34 2024-04-24T01:45:22.856 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:19.0.0-3227.g424d8c43.el9.x86_64 2/34 2024-04-24T01:45:22.857 INFO:teuthology.orchestra.run.smithi057.stdout:(2/32): ceph-selinux-19.0.0-3227.g424d8c43.el9. 255 kB/s | 25 kB 00:00 2024-04-24T01:45:22.944 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rados-2:19.0.0-3227.g424d8c43.el9.x86_64 3/34 2024-04-24T01:45:22.966 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs2-2:19.0.0-3227.g424d8c43.el9.x86_64 4/34 2024-04-24T01:45:22.967 INFO:teuthology.orchestra.run.smithi057.stdout:(3/32): libcephfs2-19.0.0-3227.g424d8c43.el9.x8 7.1 MB/s | 796 kB 00:00 2024-04-24T01:45:23.028 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephfs2-2:19.0.0-3227.g424d8c43.el9.x86_64 4/34 2024-04-24T01:45:23.066 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/34 2024-04-24T01:45:23.075 INFO:teuthology.orchestra.run.smithi057.stdout:(4/32): ceph-radosgw-19.0.0-3227.g424d8c43.el9. 9.1 MB/s | 10 MB 00:01 2024-04-24T01:45:23.104 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/34 2024-04-24T01:45:23.117 INFO:teuthology.orchestra.run.smithi057.stdout:(5/32): libradosstriper1-19.0.0-3227.g424d8c43. 3.6 MB/s | 548 kB 00:00 2024-04-24T01:45:23.129 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/34 2024-04-24T01:45:23.152 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/34 2024-04-24T01:45:23.178 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/34 2024-04-24T01:45:23.201 INFO:teuthology.orchestra.run.smithi057.stdout:(6/32): python3-ceph-argparse-19.0.0-3227.g424d 541 kB/s | 45 kB 00:00 2024-04-24T01:45:23.293 INFO:teuthology.orchestra.run.smithi057.stdout:(7/32): python3-ceph-common-19.0.0-3227.g424d8c 1.4 MB/s | 135 kB 00:00 2024-04-24T01:45:23.385 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/34 2024-04-24T01:45:23.393 INFO:teuthology.orchestra.run.smithi057.stdout:(8/32): python3-cephfs-19.0.0-3227.g424d8c43.el 1.6 MB/s | 159 kB 00:00 2024-04-24T01:45:23.418 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/34 2024-04-24T01:45:23.468 INFO:teuthology.orchestra.run.smithi057.stdout:(9/32): librgw2-19.0.0-3227.g424d8c43.el9.x86_6 13 MB/s | 5.2 MB 00:00 2024-04-24T01:45:23.493 INFO:teuthology.orchestra.run.smithi057.stdout:(10/32): python3-rados-19.0.0-3227.g424d8c43.el 3.1 MB/s | 315 kB 00:00 2024-04-24T01:45:23.535 INFO:teuthology.orchestra.run.smithi057.stdout:(11/32): python3-rbd-19.0.0-3227.g424d8c43.el9. 4.3 MB/s | 293 kB 00:00 2024-04-24T01:45:23.560 INFO:teuthology.orchestra.run.smithi057.stdout:(12/32): python3-rgw-19.0.0-3227.g424d8c43.el9. 1.5 MB/s | 99 kB 00:00 2024-04-24T01:45:23.653 INFO:teuthology.orchestra.run.smithi057.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 916 kB/s | 107 kB 00:00 2024-04-24T01:45:23.686 INFO:teuthology.orchestra.run.smithi057.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-04-24T01:45:23.711 INFO:teuthology.orchestra.run.smithi057.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 775 kB/s | 45 kB 00:00 2024-04-24T01:45:23.770 INFO:teuthology.orchestra.run.smithi057.stdout:(16/32): librdkafka-1.6.1-102.el9.x86_64.rpm 7.8 MB/s | 662 kB 00:00 2024-04-24T01:45:23.779 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/34 2024-04-24T01:45:23.831 INFO:teuthology.orchestra.run.smithi084.stdout: Upgrading : librbd1-2:19.0.0-3227.g424d8c43.el9.x86_64 11/34 2024-04-24T01:45:23.890 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:19.0.0-3227.g424d8c43.el9.x86_64 11/34 2024-04-24T01:45:23.932 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-argparse-2:19.0.0-3227.g424d8c43.el9. 12/34 2024-04-24T01:45:23.954 INFO:teuthology.orchestra.run.smithi057.stdout:(17/32): ceph-common-19.0.0-3227.g424d8c43.el9. 9.7 MB/s | 19 MB 00:01 2024-04-24T01:45:23.979 INFO:teuthology.orchestra.run.smithi057.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 203 kB/s | 42 kB 00:00 2024-04-24T01:45:23.987 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cephfs-2:19.0.0-3227.g424d8c43.el9.x86_64 13/34 2024-04-24T01:45:24.004 INFO:teuthology.orchestra.run.smithi057.stdout:(19/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.0 MB/s | 292 kB 00:00 2024-04-24T01:45:24.021 INFO:teuthology.orchestra.run.smithi057.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 849 kB/s | 36 kB 00:00 2024-04-24T01:45:24.029 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rbd-2:19.0.0-3227.g424d8c43.el9.x86_64 14/34 2024-04-24T01:45:24.038 INFO:teuthology.orchestra.run.smithi057.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-04-24T01:45:24.089 INFO:teuthology.orchestra.run.smithi057.stdout:(22/32): qatlib-24.02.0-1.el9.x86_64.rpm 1.6 MB/s | 221 kB 00:00 2024-04-24T01:45:24.117 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 15/34 2024-04-24T01:45:24.159 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libradosstriper1-2:19.0.0-3227.g424d8c43.el9.x86_6 16/34 2024-04-24T01:45:24.238 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3227.g424d8c43.el9.x86_6 16/34 2024-04-24T01:45:24.274 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : thrift-0.15.0-2.el9.x86_64 17/34 2024-04-24T01:45:24.385 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : re2-1:20211101-3.el9.x86_64 18/34 2024-04-24T01:45:24.424 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 19/34 2024-04-24T01:45:24.439 INFO:teuthology.orchestra.run.smithi057.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 74 kB/s | 26 kB 00:00 2024-04-24T01:45:24.464 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 20/34 2024-04-24T01:45:24.490 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 21/34 2024-04-24T01:45:24.519 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 22/34 2024-04-24T01:45:24.539 INFO:teuthology.orchestra.run.smithi057.stdout:(24/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 597 kB/s | 309 kB 00:00 2024-04-24T01:45:24.550 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 23/34 2024-04-24T01:45:24.586 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-24T01:45:24.606 INFO:teuthology.orchestra.run.smithi057.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 291 kB/s | 49 kB 00:00 2024-04-24T01:45:24.640 INFO:teuthology.orchestra.run.smithi057.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 672 kB/s | 67 kB 00:00 2024-04-24T01:45:24.740 INFO:teuthology.orchestra.run.smithi057.stdout:(27/32): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-04-24T01:45:24.874 INFO:teuthology.orchestra.run.smithi057.stdout:(28/32): libarrow-9.0.0-10.el9.x86_64.rpm 5.3 MB/s | 4.4 MB 00:00 2024-04-24T01:45:24.974 INFO:teuthology.orchestra.run.smithi057.stdout:(29/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.2 MB/s | 838 kB 00:00 2024-04-24T01:45:25.007 INFO:teuthology.orchestra.run.smithi057.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 5.9 MB/s | 1.6 MB 00:00 2024-04-24T01:45:25.149 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-04-24T01:45:25.173 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librgw2-2:19.0.0-3227.g424d8c43.el9.x86_64 26/34 2024-04-24T01:45:25.208 INFO:teuthology.orchestra.run.smithi057.stdout:(31/32): librados2-19.0.0-3227.g424d8c43.el9.x8 10 MB/s | 3.4 MB 00:00 2024-04-24T01:45:25.228 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librgw2-2:19.0.0-3227.g424d8c43.el9.x86_64 26/34 2024-04-24T01:45:25.291 INFO:teuthology.orchestra.run.smithi057.stdout:(32/32): librbd1-19.0.0-3227.g424d8c43.el9.x86_ 12 MB/s | 3.7 MB 00:00 2024-04-24T01:45:25.294 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:45:25.294 INFO:teuthology.orchestra.run.smithi057.stdout:Total 16 MB/s | 59 MB 00:03 2024-04-24T01:45:25.304 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rgw-2:19.0.0-3227.g424d8c43.el9.x86_64 27/34 2024-04-24T01:45:25.334 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ceph-common-2:19.0.0-3227.g424d8c43.el9.x8 28/34 2024-04-24T01:45:25.398 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-04-24T01:45:25.439 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-04-24T01:45:25.439 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-04-24T01:45:25.928 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-04-24T01:45:25.928 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-04-24T01:45:27.479 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-04-24T01:45:27.734 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:19.0.0-3227.g424d8c43.el9.x86_64 29/34 2024-04-24T01:45:27.780 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-common-2:19.0.0-3227.g424d8c43.el9.x86_64 29/34 2024-04-24T01:45:28.016 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-04-24T01:45:28.068 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librados2-2:19.0.0-3227.g424d8c43.el9.x86_64 2/34 2024-04-24T01:45:28.161 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-2:19.0.0-3227.g424d8c43.el9.x86_64 2/34 2024-04-24T01:45:28.252 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rados-2:19.0.0-3227.g424d8c43.el9.x86_64 3/34 2024-04-24T01:45:28.278 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephfs2-2:19.0.0-3227.g424d8c43.el9.x86_64 4/34 2024-04-24T01:45:28.332 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephfs2-2:19.0.0-3227.g424d8c43.el9.x86_64 4/34 2024-04-24T01:45:28.370 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : liboath-2.6.7-2.el9.x86_64 5/34 2024-04-24T01:45:28.399 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/34 2024-04-24T01:45:28.426 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/34 2024-04-24T01:45:28.443 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-common-2:19.0.0-3227.g424d8c43.el9.x86_64 29/34 2024-04-24T01:45:28.449 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 8/34 2024-04-24T01:45:28.475 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 8/34 2024-04-24T01:45:28.500 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-base-2:19.0.0-3227.g424d8c43.el9.x86_64 30/34 2024-04-24T01:45:28.591 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-base-2:19.0.0-3227.g424d8c43.el9.x86_64 30/34 2024-04-24T01:45:28.591 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-24T01:45:28.591 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-24T01:45:28.591 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:45:28.618 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-selinux-2:19.0.0-3227.g424d8c43.el9.x86_64 31/34 2024-04-24T01:45:28.667 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 9/34 2024-04-24T01:45:28.698 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 9/34 2024-04-24T01:45:29.072 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 10/34 2024-04-24T01:45:29.119 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librbd1-2:19.0.0-3227.g424d8c43.el9.x86_64 11/34 2024-04-24T01:45:29.187 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librbd1-2:19.0.0-3227.g424d8c43.el9.x86_64 11/34 2024-04-24T01:45:29.229 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ceph-argparse-2:19.0.0-3227.g424d8c43.el9. 12/34 2024-04-24T01:45:29.285 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cephfs-2:19.0.0-3227.g424d8c43.el9.x86_64 13/34 2024-04-24T01:45:29.317 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rbd-2:19.0.0-3227.g424d8c43.el9.x86_64 14/34 2024-04-24T01:45:29.407 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 15/34 2024-04-24T01:45:29.430 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libradosstriper1-2:19.0.0-3227.g424d8c43.el9.x86_6 16/34 2024-04-24T01:45:29.518 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3227.g424d8c43.el9.x86_6 16/34 2024-04-24T01:45:29.553 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : thrift-0.15.0-2.el9.x86_64 17/34 2024-04-24T01:45:29.665 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : re2-1:20211101-3.el9.x86_64 18/34 2024-04-24T01:45:29.696 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 19/34 2024-04-24T01:45:29.736 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 20/34 2024-04-24T01:45:29.761 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 21/34 2024-04-24T01:45:29.790 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 22/34 2024-04-24T01:45:29.821 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 23/34 2024-04-24T01:45:29.857 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-04-24T01:45:30.459 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-04-24T01:45:30.486 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librgw2-2:19.0.0-3227.g424d8c43.el9.x86_64 26/34 2024-04-24T01:45:30.557 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librgw2-2:19.0.0-3227.g424d8c43.el9.x86_64 26/34 2024-04-24T01:45:30.637 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rgw-2:19.0.0-3227.g424d8c43.el9.x86_64 27/34 2024-04-24T01:45:30.680 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ceph-common-2:19.0.0-3227.g424d8c43.el9.x8 28/34 2024-04-24T01:45:33.387 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:19.0.0-3227.g424d8c43.el9.x86_64 29/34 2024-04-24T01:45:33.426 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-common-2:19.0.0-3227.g424d8c43.el9.x86_64 29/34 2024-04-24T01:45:34.137 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:19.0.0-3227.g424d8c43.el9.x86_64 29/34 2024-04-24T01:45:34.191 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-base-2:19.0.0-3227.g424d8c43.el9.x86_64 30/34 2024-04-24T01:45:34.279 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-base-2:19.0.0-3227.g424d8c43.el9.x86_64 30/34 2024-04-24T01:45:34.279 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-24T01:45:34.279 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-24T01:45:34.279 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:45:34.314 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-selinux-2:19.0.0-3227.g424d8c43.el9.x86_64 31/34 2024-04-24T01:45:38.376 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3227.g424d8c43.el9.x86_64 31/34 2024-04-24T01:45:38.376 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /sys 2024-04-24T01:45:38.376 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /proc 2024-04-24T01:45:38.376 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /mnt 2024-04-24T01:45:38.376 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /var/tmp 2024-04-24T01:45:38.376 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /home 2024-04-24T01:45:38.376 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /root 2024-04-24T01:45:38.377 INFO:teuthology.orchestra.run.smithi084.stdout:skipping the directory /tmp 2024-04-24T01:45:38.377 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:45:39.458 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-radosgw-2:19.0.0-3227.g424d8c43.el9.x86_64 32/34 2024-04-24T01:45:39.486 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3227.g424d8c43.el9.x86_64 32/34 2024-04-24T01:45:39.486 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:45:39.486 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-24T01:45:39.486 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-24T01:45:39.486 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-24T01:45:39.486 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:45:39.488 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-24T01:45:39.578 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-24T01:45:39.578 INFO:teuthology.orchestra.run.smithi084.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-24T01:45:40.938 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-24T01:45:40.938 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-base-2:19.0.0-3227.g424d8c43.el9.x86_64 1/34 2024-04-24T01:45:40.939 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-common-2:19.0.0-3227.g424d8c43.el9.x86_64 2/34 2024-04-24T01:45:40.939 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-radosgw-2:19.0.0-3227.g424d8c43.el9.x86_64 3/34 2024-04-24T01:45:40.939 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-selinux-2:19.0.0-3227.g424d8c43.el9.x86_64 4/34 2024-04-24T01:45:40.939 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs2-2:19.0.0-3227.g424d8c43.el9.x86_64 5/34 2024-04-24T01:45:40.939 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libradosstriper1-2:19.0.0-3227.g424d8c43.el9.x86_6 6/34 2024-04-24T01:45:40.939 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librgw2-2:19.0.0-3227.g424d8c43.el9.x86_64 7/34 2024-04-24T01:45:40.939 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3227.g424d8c43.el9. 8/34 2024-04-24T01:45:40.939 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ceph-common-2:19.0.0-3227.g424d8c43.el9.x8 9/34 2024-04-24T01:45:40.939 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cephfs-2:19.0.0-3227.g424d8c43.el9.x86_64 10/34 2024-04-24T01:45:40.939 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rados-2:19.0.0-3227.g424d8c43.el9.x86_64 11/34 2024-04-24T01:45:40.939 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rbd-2:19.0.0-3227.g424d8c43.el9.x86_64 12/34 2024-04-24T01:45:40.939 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rgw-2:19.0.0-3227.g424d8c43.el9.x86_64 13/34 2024-04-24T01:45:40.939 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-24T01:45:40.940 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-24T01:45:40.940 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-24T01:45:40.940 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-24T01:45:40.940 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-24T01:45:40.940 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-24T01:45:40.940 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-24T01:45:40.940 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-24T01:45:40.940 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-24T01:45:40.940 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-24T01:45:40.940 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-04-24T01:45:40.940 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-04-24T01:45:40.940 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-24T01:45:40.940 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-24T01:45:40.940 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-04-24T01:45:40.941 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-24T01:45:40.941 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-24T01:45:40.941 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:19.0.0-3227.g424d8c43.el9.x86_64 31/34 2024-04-24T01:45:40.941 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-24T01:45:40.941 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:19.0.0-3227.g424d8c43.el9.x86_64 33/34 2024-04-24T01:45:41.665 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-24T01:45:41.666 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:45:41.666 INFO:teuthology.orchestra.run.smithi084.stdout:Upgraded: 2024-04-24T01:45:41.666 INFO:teuthology.orchestra.run.smithi084.stdout: librados2-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:45:41.666 INFO:teuthology.orchestra.run.smithi084.stdout: librbd1-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:45:41.666 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-24T01:45:41.666 INFO:teuthology.orchestra.run.smithi084.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-24T01:45:41.666 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-base-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:45:41.666 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-common-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:45:41.666 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-radosgw-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:45:41.666 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-selinux-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:45:41.666 INFO:teuthology.orchestra.run.smithi084.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-24T01:45:41.666 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-24T01:45:41.666 INFO:teuthology.orchestra.run.smithi084.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-24T01:45:41.666 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs2-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:45:41.667 INFO:teuthology.orchestra.run.smithi084.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-24T01:45:41.667 INFO:teuthology.orchestra.run.smithi084.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-24T01:45:41.667 INFO:teuthology.orchestra.run.smithi084.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-24T01:45:41.667 INFO:teuthology.orchestra.run.smithi084.stdout: libradosstriper1-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:45:41.667 INFO:teuthology.orchestra.run.smithi084.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-24T01:45:41.667 INFO:teuthology.orchestra.run.smithi084.stdout: librgw2-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:45:41.667 INFO:teuthology.orchestra.run.smithi084.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-24T01:45:41.667 INFO:teuthology.orchestra.run.smithi084.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-24T01:45:41.667 INFO:teuthology.orchestra.run.smithi084.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-24T01:45:41.667 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-argparse-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:45:41.667 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ceph-common-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:45:41.667 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cephfs-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:45:41.667 INFO:teuthology.orchestra.run.smithi084.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-24T01:45:41.667 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rados-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:45:41.667 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rbd-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:45:41.668 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rgw-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:45:41.668 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-24T01:45:41.668 INFO:teuthology.orchestra.run.smithi084.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-24T01:45:41.668 INFO:teuthology.orchestra.run.smithi084.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-24T01:45:41.668 INFO:teuthology.orchestra.run.smithi084.stdout: re2-1:20211101-3.el9.x86_64 2024-04-24T01:45:41.668 INFO:teuthology.orchestra.run.smithi084.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-24T01:45:41.668 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:45:41.668 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-24T01:45:41.929 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-test 2024-04-24T01:45:42.512 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:00:30 ago on Wed 24 Apr 2024 01:45:12 AM UTC. 2024-04-24T01:45:42.636 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-24T01:45:42.637 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:45:42.637 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-04-24T01:45:42.637 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:45:42.637 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-24T01:45:42.637 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 84 M 2024-04-24T01:45:42.637 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-04-24T01:45:42.638 INFO:teuthology.orchestra.run.smithi084.stdout: libasan8 x86_64 13.2.1-6.3.el9 appstream 469 k 2024-04-24T01:45:42.638 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 173 k 2024-04-24T01:45:42.638 INFO:teuthology.orchestra.run.smithi084.stdout: libubsan x86_64 11.4.1-3.el9 appstream 187 k 2024-04-24T01:45:42.638 INFO:teuthology.orchestra.run.smithi084.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-04-24T01:45:42.638 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-24T01:45:42.638 INFO:teuthology.orchestra.run.smithi084.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-24T01:45:42.638 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-24T01:45:42.638 INFO:teuthology.orchestra.run.smithi084.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-04-24T01:45:42.638 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:45:42.638 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-24T01:45:42.638 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:45:42.638 INFO:teuthology.orchestra.run.smithi084.stdout:Install 9 Packages 2024-04-24T01:45:42.638 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:45:42.639 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 87 M 2024-04-24T01:45:42.639 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 813 M 2024-04-24T01:45:42.639 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-24T01:45:43.281 INFO:teuthology.orchestra.run.smithi084.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 610 kB/s | 94 kB 00:00 2024-04-24T01:45:43.399 INFO:teuthology.orchestra.run.smithi084.stdout:(2/9): libcephsqlite-19.0.0-3227.g424d8c43.el9. 637 kB/s | 173 kB 00:00 2024-04-24T01:45:43.475 INFO:teuthology.orchestra.run.smithi084.stdout:(3/9): libasan8-13.2.1-6.3.el9.x86_64.rpm 2.4 MB/s | 469 kB 00:00 2024-04-24T01:45:43.567 INFO:teuthology.orchestra.run.smithi084.stdout:(4/9): protobuf-3.14.0-13.el9.x86_64.rpm 11 MB/s | 1.0 MB 00:00 2024-04-24T01:45:43.609 INFO:teuthology.orchestra.run.smithi084.stdout:(5/9): libubsan-11.4.1-3.el9.x86_64.rpm 889 kB/s | 187 kB 00:00 2024-04-24T01:45:43.655 INFO:teuthology.orchestra.run.smithi084.stdout:(6/9): socat-1.7.4.1-5.el9.x86_64.rpm 3.4 MB/s | 305 kB 00:00 2024-04-24T01:45:43.694 INFO:teuthology.orchestra.run.smithi084.stdout:(7/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 757 kB/s | 64 kB 00:00 2024-04-24T01:45:43.837 INFO:teuthology.orchestra.run.smithi084.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 672 kB/s | 122 kB 00:00 2024-04-24T01:45:44.845 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3227.g424d8c43.el9.x86_64 31/34 2024-04-24T01:45:44.845 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /sys 2024-04-24T01:45:44.845 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /proc 2024-04-24T01:45:44.845 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /mnt 2024-04-24T01:45:44.845 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /var/tmp 2024-04-24T01:45:44.845 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /home 2024-04-24T01:45:44.846 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /root 2024-04-24T01:45:44.846 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /tmp 2024-04-24T01:45:44.846 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:45:45.955 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-radosgw-2:19.0.0-3227.g424d8c43.el9.x86_64 32/34 2024-04-24T01:45:45.980 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3227.g424d8c43.el9.x86_64 32/34 2024-04-24T01:45:45.980 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:45:45.980 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-24T01:45:45.980 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-24T01:45:45.980 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-24T01:45:45.980 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:45:45.982 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-24T01:45:46.065 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-04-24T01:45:46.066 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-24T01:45:47.249 INFO:teuthology.orchestra.run.smithi084.stdout:(9/9): ceph-test-19.0.0-3227.g424d8c43.el9.x86_ 20 MB/s | 84 MB 00:04 2024-04-24T01:45:47.251 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:45:47.252 INFO:teuthology.orchestra.run.smithi084.stdout:Total 19 MB/s | 87 MB 00:04 2024-04-24T01:45:47.330 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-24T01:45:47.353 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-24T01:45:47.353 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-24T01:45:47.566 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-04-24T01:45:47.566 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-base-2:19.0.0-3227.g424d8c43.el9.x86_64 1/34 2024-04-24T01:45:47.566 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-common-2:19.0.0-3227.g424d8c43.el9.x86_64 2/34 2024-04-24T01:45:47.567 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-radosgw-2:19.0.0-3227.g424d8c43.el9.x86_64 3/34 2024-04-24T01:45:47.567 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-selinux-2:19.0.0-3227.g424d8c43.el9.x86_64 4/34 2024-04-24T01:45:47.567 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs2-2:19.0.0-3227.g424d8c43.el9.x86_64 5/34 2024-04-24T01:45:47.567 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libradosstriper1-2:19.0.0-3227.g424d8c43.el9.x86_6 6/34 2024-04-24T01:45:47.567 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librgw2-2:19.0.0-3227.g424d8c43.el9.x86_64 7/34 2024-04-24T01:45:47.567 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3227.g424d8c43.el9. 8/34 2024-04-24T01:45:47.567 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-common-2:19.0.0-3227.g424d8c43.el9.x8 9/34 2024-04-24T01:45:47.567 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cephfs-2:19.0.0-3227.g424d8c43.el9.x86_64 10/34 2024-04-24T01:45:47.567 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rados-2:19.0.0-3227.g424d8c43.el9.x86_64 11/34 2024-04-24T01:45:47.567 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rbd-2:19.0.0-3227.g424d8c43.el9.x86_64 12/34 2024-04-24T01:45:47.567 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rgw-2:19.0.0-3227.g424d8c43.el9.x86_64 13/34 2024-04-24T01:45:47.567 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-04-24T01:45:47.567 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-04-24T01:45:47.567 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-04-24T01:45:47.567 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-04-24T01:45:47.568 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-04-24T01:45:47.568 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-04-24T01:45:47.568 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-04-24T01:45:47.568 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-04-24T01:45:47.568 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-04-24T01:45:47.568 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-04-24T01:45:47.568 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-04-24T01:45:47.568 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-04-24T01:45:47.568 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-04-24T01:45:47.568 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-04-24T01:45:47.569 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-04-24T01:45:47.569 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-04-24T01:45:47.569 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-04-24T01:45:47.569 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-2:19.0.0-3227.g424d8c43.el9.x86_64 31/34 2024-04-24T01:45:47.569 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-04-24T01:45:47.569 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-2:19.0.0-3227.g424d8c43.el9.x86_64 33/34 2024-04-24T01:45:47.953 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-24T01:45:47.953 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-24T01:45:48.371 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-04-24T01:45:48.371 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:45:48.371 INFO:teuthology.orchestra.run.smithi057.stdout:Upgraded: 2024-04-24T01:45:48.371 INFO:teuthology.orchestra.run.smithi057.stdout: librados2-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:45:48.371 INFO:teuthology.orchestra.run.smithi057.stdout: librbd1-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:45:48.371 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-04-24T01:45:48.371 INFO:teuthology.orchestra.run.smithi057.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-24T01:45:48.371 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:45:48.372 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:45:48.372 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:45:48.372 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-selinux-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:45:48.372 INFO:teuthology.orchestra.run.smithi057.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-24T01:45:48.372 INFO:teuthology.orchestra.run.smithi057.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-24T01:45:48.372 INFO:teuthology.orchestra.run.smithi057.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-24T01:45:48.372 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:45:48.372 INFO:teuthology.orchestra.run.smithi057.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-24T01:45:48.372 INFO:teuthology.orchestra.run.smithi057.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-24T01:45:48.372 INFO:teuthology.orchestra.run.smithi057.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-24T01:45:48.372 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:45:48.372 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-24T01:45:48.372 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:45:48.372 INFO:teuthology.orchestra.run.smithi057.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-24T01:45:48.372 INFO:teuthology.orchestra.run.smithi057.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-24T01:45:48.373 INFO:teuthology.orchestra.run.smithi057.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-24T01:45:48.373 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:45:48.373 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:45:48.373 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:45:48.373 INFO:teuthology.orchestra.run.smithi057.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-24T01:45:48.373 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:45:48.373 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:45:48.373 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:45:48.373 INFO:teuthology.orchestra.run.smithi057.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-24T01:45:48.373 INFO:teuthology.orchestra.run.smithi057.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-24T01:45:48.373 INFO:teuthology.orchestra.run.smithi057.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-24T01:45:48.373 INFO:teuthology.orchestra.run.smithi057.stdout: re2-1:20211101-3.el9.x86_64 2024-04-24T01:45:48.373 INFO:teuthology.orchestra.run.smithi057.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-24T01:45:48.373 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:45:48.373 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-24T01:45:48.671 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-test 2024-04-24T01:45:48.822 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-24T01:45:48.906 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-04-24T01:45:48.950 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-04-24T01:45:48.995 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 3/9 2024-04-24T01:45:49.021 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-04-24T01:45:49.051 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libubsan-11.4.1-3.el9.x86_64 5/9 2024-04-24T01:45:49.077 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libasan8-13.2.1-6.3.el9.x86_64 6/9 2024-04-24T01:45:49.146 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libasan8-13.2.1-6.3.el9.x86_64 6/9 2024-04-24T01:45:49.194 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-04-24T01:45:49.214 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:00:30 ago on Wed 24 Apr 2024 01:45:19 AM UTC. 2024-04-24T01:45:49.221 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephsqlite-2:19.0.0-3227.g424d8c43.el9.x86_64 8/9 2024-04-24T01:45:49.339 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-24T01:45:49.340 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:45:49.340 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-04-24T01:45:49.340 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:45:49.340 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-04-24T01:45:49.340 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 84 M 2024-04-24T01:45:49.340 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-04-24T01:45:49.340 INFO:teuthology.orchestra.run.smithi057.stdout: libasan8 x86_64 13.2.1-6.3.el9 appstream 469 k 2024-04-24T01:45:49.340 INFO:teuthology.orchestra.run.smithi057.stdout: libcephsqlite x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 173 k 2024-04-24T01:45:49.341 INFO:teuthology.orchestra.run.smithi057.stdout: libubsan x86_64 11.4.1-3.el9 appstream 187 k 2024-04-24T01:45:49.341 INFO:teuthology.orchestra.run.smithi057.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-04-24T01:45:49.341 INFO:teuthology.orchestra.run.smithi057.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-24T01:45:49.341 INFO:teuthology.orchestra.run.smithi057.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-24T01:45:49.341 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-24T01:45:49.341 INFO:teuthology.orchestra.run.smithi057.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2024-04-24T01:45:49.341 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:45:49.341 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-24T01:45:49.341 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:45:49.341 INFO:teuthology.orchestra.run.smithi057.stdout:Install 9 Packages 2024-04-24T01:45:49.341 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:45:49.342 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 87 M 2024-04-24T01:45:49.342 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 813 M 2024-04-24T01:45:49.342 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-04-24T01:45:49.766 INFO:teuthology.orchestra.run.smithi057.stdout:(1/9): lksctp-tools-1.0.19-2.el9.x86_64.rpm 712 kB/s | 94 kB 00:00 2024-04-24T01:45:49.875 INFO:teuthology.orchestra.run.smithi057.stdout:(2/9): libasan8-13.2.1-6.3.el9.x86_64.rpm 4.2 MB/s | 469 kB 00:00 2024-04-24T01:45:49.908 INFO:teuthology.orchestra.run.smithi057.stdout:(3/9): libcephsqlite-19.0.0-3227.g424d8c43.el9. 630 kB/s | 173 kB 00:00 2024-04-24T01:45:49.959 INFO:teuthology.orchestra.run.smithi057.stdout:(4/9): libubsan-11.4.1-3.el9.x86_64.rpm 2.2 MB/s | 187 kB 00:00 2024-04-24T01:45:50.009 INFO:teuthology.orchestra.run.smithi057.stdout:(5/9): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 305 kB 00:00 2024-04-24T01:45:50.060 INFO:teuthology.orchestra.run.smithi057.stdout:(6/9): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-24T01:45:50.161 INFO:teuthology.orchestra.run.smithi057.stdout:(7/9): protobuf-3.14.0-13.el9.x86_64.rpm 4.0 MB/s | 1.0 MB 00:00 2024-04-24T01:45:50.338 INFO:teuthology.orchestra.run.smithi057.stdout:(8/9): yaml-cpp-0.6.3-5.el9.x86_64.rpm 439 kB/s | 122 kB 00:00 2024-04-24T01:45:53.619 INFO:teuthology.orchestra.run.smithi057.stdout:(9/9): ceph-test-19.0.0-3227.g424d8c43.el9.x86_ 21 MB/s | 84 MB 00:03 2024-04-24T01:45:53.621 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:45:53.621 INFO:teuthology.orchestra.run.smithi057.stdout:Total 20 MB/s | 87 MB 00:04 2024-04-24T01:45:53.704 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-04-24T01:45:53.729 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-04-24T01:45:53.729 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-04-24T01:45:54.357 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-04-24T01:45:54.359 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-04-24T01:45:55.264 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-04-24T01:45:55.343 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/9 2024-04-24T01:45:55.387 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 2/9 2024-04-24T01:45:55.432 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 3/9 2024-04-24T01:45:55.458 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 4/9 2024-04-24T01:45:55.488 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libubsan-11.4.1-3.el9.x86_64 5/9 2024-04-24T01:45:55.514 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libasan8-13.2.1-6.3.el9.x86_64 6/9 2024-04-24T01:45:55.583 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libasan8-13.2.1-6.3.el9.x86_64 6/9 2024-04-24T01:45:55.623 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 7/9 2024-04-24T01:45:55.648 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephsqlite-2:19.0.0-3227.g424d8c43.el9.x86_64 8/9 2024-04-24T01:46:00.512 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3227.g424d8c43.el9.x86_64 8/9 2024-04-24T01:46:00.591 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-test-2:19.0.0-3227.g424d8c43.el9.x86_64 9/9 2024-04-24T01:46:06.651 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-test-2:19.0.0-3227.g424d8c43.el9.x86_64 9/9 2024-04-24T01:46:06.651 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-test-2:19.0.0-3227.g424d8c43.el9.x86_64 1/9 2024-04-24T01:46:06.651 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephsqlite-2:19.0.0-3227.g424d8c43.el9.x86_64 2/9 2024-04-24T01:46:06.651 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-04-24T01:46:06.651 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libasan8-13.2.1-6.3.el9.x86_64 4/9 2024-04-24T01:46:06.651 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libubsan-11.4.1-3.el9.x86_64 5/9 2024-04-24T01:46:06.651 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-04-24T01:46:06.652 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 7/9 2024-04-24T01:46:06.652 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-04-24T01:46:06.955 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-04-24T01:46:06.955 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:46:06.955 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-24T01:46:06.955 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-test-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:46:06.955 INFO:teuthology.orchestra.run.smithi084.stdout: libasan8-13.2.1-6.3.el9.x86_64 2024-04-24T01:46:06.955 INFO:teuthology.orchestra.run.smithi084.stdout: libcephsqlite-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:46:06.955 INFO:teuthology.orchestra.run.smithi084.stdout: libubsan-11.4.1-3.el9.x86_64 2024-04-24T01:46:06.955 INFO:teuthology.orchestra.run.smithi084.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-04-24T01:46:06.955 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-24T01:46:06.956 INFO:teuthology.orchestra.run.smithi084.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-24T01:46:06.956 INFO:teuthology.orchestra.run.smithi084.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-24T01:46:06.956 INFO:teuthology.orchestra.run.smithi084.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-04-24T01:46:06.956 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:46:06.956 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-24T01:46:07.287 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph 2024-04-24T01:46:07.650 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3227.g424d8c43.el9.x86_64 8/9 2024-04-24T01:46:07.730 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-test-2:19.0.0-3227.g424d8c43.el9.x86_64 9/9 2024-04-24T01:46:07.795 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:00:55 ago on Wed 24 Apr 2024 01:45:12 AM UTC. 2024-04-24T01:46:07.916 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-24T01:46:07.918 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:46:07.918 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-04-24T01:46:07.918 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:46:07.919 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-24T01:46:07.919 INFO:teuthology.orchestra.run.smithi084.stdout: ceph x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 6.5 k 2024-04-24T01:46:07.919 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-04-24T01:46:07.919 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 2.2 M 2024-04-24T01:46:07.919 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 1.6 M 2024-04-24T01:46:07.919 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3227.g424d8c43.el9 ceph-noarch 249 k 2024-04-24T01:46:07.919 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 5.0 M 2024-04-24T01:46:07.919 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 71 M 2024-04-24T01:46:07.919 INFO:teuthology.orchestra.run.smithi084.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-24T01:46:07.919 INFO:teuthology.orchestra.run.smithi084.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-24T01:46:07.919 INFO:teuthology.orchestra.run.smithi084.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-24T01:46:07.919 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-24T01:46:07.919 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-24T01:46:07.919 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-24T01:46:07.920 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-24T01:46:07.920 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-24T01:46:07.920 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-24T01:46:07.920 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-24T01:46:07.920 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-collections 2024-04-24T01:46:07.920 INFO:teuthology.orchestra.run.smithi084.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-04-24T01:46:07.920 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-24T01:46:07.920 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-24T01:46:07.920 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-24T01:46:07.920 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-24T01:46:07.920 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-24T01:46:07.920 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-24T01:46:07.920 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-24T01:46:07.921 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-24T01:46:07.921 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-24T01:46:07.921 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-24T01:46:07.921 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-24T01:46:07.921 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-24T01:46:07.921 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-24T01:46:07.921 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-24T01:46:07.921 INFO:teuthology.orchestra.run.smithi084.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-24T01:46:07.921 INFO:teuthology.orchestra.run.smithi084.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-24T01:46:07.921 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-24T01:46:07.921 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-24T01:46:07.921 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-24T01:46:07.921 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:46:07.921 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-24T01:46:07.922 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:46:07.922 INFO:teuthology.orchestra.run.smithi084.stdout:Install 36 Packages 2024-04-24T01:46:07.922 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:46:07.922 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 84 M 2024-04-24T01:46:07.922 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 922 M 2024-04-24T01:46:07.923 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-24T01:46:08.911 INFO:teuthology.orchestra.run.smithi084.stdout:(1/36): ceph-19.0.0-3227.g424d8c43.el9.x86_64.r 35 kB/s | 6.5 kB 00:00 2024-04-24T01:46:09.144 INFO:teuthology.orchestra.run.smithi084.stdout:(2/36): ceph-mds-19.0.0-3227.g424d8c43.el9.x86_ 5.2 MB/s | 2.2 MB 00:00 2024-04-24T01:46:10.111 INFO:teuthology.orchestra.run.smithi084.stdout:(3/36): ceph-mon-19.0.0-3227.g424d8c43.el9.x86_ 4.2 MB/s | 5.0 MB 00:01 2024-04-24T01:46:10.294 INFO:teuthology.orchestra.run.smithi084.stdout:(4/36): ceph-mgr-modules-core-19.0.0-3227.g424d 1.3 MB/s | 249 kB 00:00 2024-04-24T01:46:10.470 INFO:teuthology.orchestra.run.smithi084.stdout:(5/36): ceph-mgr-19.0.0-3227.g424d8c43.el9.x86_ 914 kB/s | 1.6 MB 00:01 2024-04-24T01:46:10.545 INFO:teuthology.orchestra.run.smithi084.stdout:(6/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2024-04-24T01:46:10.645 INFO:teuthology.orchestra.run.smithi084.stdout:(7/36): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2024-04-24T01:46:10.704 INFO:teuthology.orchestra.run.smithi084.stdout:(8/36): python3-pycparser-2.20-6.el9.noarch.rpm 2.3 MB/s | 135 kB 00:00 2024-04-24T01:46:10.762 INFO:teuthology.orchestra.run.smithi084.stdout:(9/36): python3-requests-2.25.1-8.el9.noarch.rp 2.1 MB/s | 125 kB 00:00 2024-04-24T01:46:10.871 INFO:teuthology.orchestra.run.smithi084.stdout:(10/36): python3-urllib3-1.26.5-5.el9.noarch.rp 1.9 MB/s | 215 kB 00:00 2024-04-24T01:46:11.046 INFO:teuthology.orchestra.run.smithi084.stdout:(11/36): python3-cryptography-36.0.1-4.el9.x86_ 2.1 MB/s | 1.2 MB 00:00 2024-04-24T01:46:11.071 INFO:teuthology.orchestra.run.smithi084.stdout:(12/36): lua-5.4.4-4.el9.x86_64.rpm 941 kB/s | 188 kB 00:00 2024-04-24T01:46:11.122 INFO:teuthology.orchestra.run.smithi084.stdout:(13/36): python3-markupsafe-1.1.1-12.el9.x86_64 695 kB/s | 35 kB 00:00 2024-04-24T01:46:11.172 INFO:teuthology.orchestra.run.smithi084.stdout:(14/36): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-24T01:46:11.214 INFO:teuthology.orchestra.run.smithi084.stdout:(15/36): python3-mako-1.1.4-6.el9.noarch.rpm 1.0 MB/s | 172 kB 00:00 2024-04-24T01:46:11.239 INFO:teuthology.orchestra.run.smithi084.stdout:(16/36): python3-toml-0.10.2-6.el9.noarch.rpm 622 kB/s | 42 kB 00:00 2024-04-24T01:46:11.515 INFO:teuthology.orchestra.run.smithi084.stdout:(17/36): lua-devel-5.4.4-4.el9.x86_64.rpm 74 kB/s | 22 kB 00:00 2024-04-24T01:46:11.906 INFO:teuthology.orchestra.run.smithi084.stdout:(18/36): luarocks-3.9.2-1.el9.noarch.rpm 226 kB/s | 151 kB 00:00 2024-04-24T01:46:11.932 INFO:teuthology.orchestra.run.smithi084.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 104 kB/s | 43 kB 00:00 2024-04-24T01:46:12.682 INFO:teuthology.orchestra.run.smithi084.stdout:(20/36): ceph-osd-19.0.0-3227.g424d8c43.el9.x86 20 MB/s | 71 MB 00:03 2024-04-24T01:46:12.707 INFO:teuthology.orchestra.run.smithi084.stdout:(21/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 215 kB/s | 172 kB 00:00 2024-04-24T01:46:12.841 INFO:teuthology.orchestra.run.smithi084.stdout:(22/36): python3-jaraco-classes-3.2.1-5.el9.noa 132 kB/s | 18 kB 00:00 2024-04-24T01:46:12.891 INFO:teuthology.orchestra.run.smithi084.stdout:(23/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 51 kB/s | 11 kB 00:00 2024-04-24T01:46:12.958 INFO:teuthology.orchestra.run.smithi084.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 198 kB/s | 23 kB 00:00 2024-04-24T01:46:13.075 INFO:teuthology.orchestra.run.smithi084.stdout:(25/36): python3-jaraco-text-3.2.0-6.el9.noarch 168 kB/s | 20 kB 00:00 2024-04-24T01:46:13.100 INFO:teuthology.orchestra.run.smithi084.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 93 kB/s | 19 kB 00:00 2024-04-24T01:46:13.159 INFO:teuthology.orchestra.run.smithi084.stdout:(27/36): python3-cherrypy-18.6.1-2.el9.noarch.r 292 kB/s | 358 kB 00:01 2024-04-24T01:46:13.192 INFO:teuthology.orchestra.run.smithi084.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 395 kB/s | 46 kB 00:00 2024-04-24T01:46:13.309 INFO:teuthology.orchestra.run.smithi084.stdout:(29/36): python3-portend-3.1.0-2.el9.noarch.rpm 141 kB/s | 16 kB 00:00 2024-04-24T01:46:13.401 INFO:teuthology.orchestra.run.smithi084.stdout:(30/36): python3-more-itertools-8.12.0-2.el9.no 262 kB/s | 79 kB 00:00 2024-04-24T01:46:13.518 INFO:teuthology.orchestra.run.smithi084.stdout:(31/36): python3-tempora-5.0.0-2.el9.noarch.rpm 307 kB/s | 36 kB 00:00 2024-04-24T01:46:13.543 INFO:teuthology.orchestra.run.smithi084.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 385 kB/s | 90 kB 00:00 2024-04-24T01:46:13.735 INFO:teuthology.orchestra.run.smithi084.stdout:(33/36): python3-pecan-1.4.2-3.el9.noarch.rpm 473 kB/s | 272 kB 00:00 2024-04-24T01:46:13.844 INFO:teuthology.orchestra.run.smithi084.stdout:(34/36): python3-zc-lockfile-2.0-10.el9.noarch. 184 kB/s | 20 kB 00:00 2024-04-24T01:46:14.002 INFO:teuthology.orchestra.run.smithi084.stdout:(35/36): python3-webob-1.8.7-6.el9.noarch.rpm 475 kB/s | 230 kB 00:00 2024-04-24T01:46:14.080 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-test-2:19.0.0-3227.g424d8c43.el9.x86_64 9/9 2024-04-24T01:46:14.081 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-test-2:19.0.0-3227.g424d8c43.el9.x86_64 1/9 2024-04-24T01:46:14.081 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephsqlite-2:19.0.0-3227.g424d8c43.el9.x86_64 2/9 2024-04-24T01:46:14.081 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 3/9 2024-04-24T01:46:14.081 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libasan8-13.2.1-6.3.el9.x86_64 4/9 2024-04-24T01:46:14.081 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libubsan-11.4.1-3.el9.x86_64 5/9 2024-04-24T01:46:14.081 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 6/9 2024-04-24T01:46:14.081 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 7/9 2024-04-24T01:46:14.081 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 8/9 2024-04-24T01:46:14.302 INFO:teuthology.orchestra.run.smithi084.stdout:(36/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 563 kB/s | 427 kB 00:00 2024-04-24T01:46:14.304 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:46:14.304 INFO:teuthology.orchestra.run.smithi084.stdout:Total 13 MB/s | 84 MB 00:06 2024-04-24T01:46:14.416 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 9/9 2024-04-24T01:46:14.416 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:46:14.416 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-04-24T01:46:14.416 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:46:14.416 INFO:teuthology.orchestra.run.smithi057.stdout: libasan8-13.2.1-6.3.el9.x86_64 2024-04-24T01:46:14.416 INFO:teuthology.orchestra.run.smithi057.stdout: libcephsqlite-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:46:14.416 INFO:teuthology.orchestra.run.smithi057.stdout: libubsan-11.4.1-3.el9.x86_64 2024-04-24T01:46:14.417 INFO:teuthology.orchestra.run.smithi057.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-04-24T01:46:14.417 INFO:teuthology.orchestra.run.smithi057.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-24T01:46:14.417 INFO:teuthology.orchestra.run.smithi057.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-24T01:46:14.417 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-24T01:46:14.417 INFO:teuthology.orchestra.run.smithi057.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2024-04-24T01:46:14.417 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:46:14.417 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-24T01:46:14.441 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-24T01:46:14.481 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-24T01:46:14.481 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-24T01:46:14.718 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph 2024-04-24T01:46:15.091 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-24T01:46:15.092 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-24T01:46:15.243 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:00:56 ago on Wed 24 Apr 2024 01:45:19 AM UTC. 2024-04-24T01:46:15.370 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-24T01:46:15.372 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:46:15.372 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-04-24T01:46:15.373 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:46:15.373 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-04-24T01:46:15.373 INFO:teuthology.orchestra.run.smithi057.stdout: ceph x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 6.5 k 2024-04-24T01:46:15.373 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-04-24T01:46:15.373 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 2.2 M 2024-04-24T01:46:15.374 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 1.6 M 2024-04-24T01:46:15.374 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3227.g424d8c43.el9 ceph-noarch 249 k 2024-04-24T01:46:15.374 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 5.0 M 2024-04-24T01:46:15.374 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 71 M 2024-04-24T01:46:15.374 INFO:teuthology.orchestra.run.smithi057.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-24T01:46:15.374 INFO:teuthology.orchestra.run.smithi057.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-24T01:46:15.374 INFO:teuthology.orchestra.run.smithi057.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-24T01:46:15.375 INFO:teuthology.orchestra.run.smithi057.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-24T01:46:15.375 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-24T01:46:15.375 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-24T01:46:15.375 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-24T01:46:15.375 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-24T01:46:15.375 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-24T01:46:15.375 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-24T01:46:15.376 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-collections 2024-04-24T01:46:15.376 INFO:teuthology.orchestra.run.smithi057.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-04-24T01:46:15.376 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-24T01:46:15.376 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-24T01:46:15.376 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-24T01:46:15.376 INFO:teuthology.orchestra.run.smithi057.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-24T01:46:15.376 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-24T01:46:15.377 INFO:teuthology.orchestra.run.smithi057.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-24T01:46:15.377 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-24T01:46:15.377 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-24T01:46:15.377 INFO:teuthology.orchestra.run.smithi057.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-24T01:46:15.377 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-24T01:46:15.378 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-24T01:46:15.378 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-24T01:46:15.378 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-24T01:46:15.378 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-24T01:46:15.378 INFO:teuthology.orchestra.run.smithi057.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-24T01:46:15.378 INFO:teuthology.orchestra.run.smithi057.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-24T01:46:15.378 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-24T01:46:15.378 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-24T01:46:15.378 INFO:teuthology.orchestra.run.smithi057.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-24T01:46:15.378 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:46:15.379 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-24T01:46:15.379 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:46:15.379 INFO:teuthology.orchestra.run.smithi057.stdout:Install 36 Packages 2024-04-24T01:46:15.379 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:46:15.380 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 84 M 2024-04-24T01:46:15.380 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 922 M 2024-04-24T01:46:15.380 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-04-24T01:46:16.589 INFO:teuthology.orchestra.run.smithi057.stdout:(1/36): ceph-19.0.0-3227.g424d8c43.el9.x86_64.r 34 kB/s | 6.5 kB 00:00 2024-04-24T01:46:16.663 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-24T01:46:16.730 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-24T01:46:16.771 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-24T01:46:16.799 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-24T01:46:16.814 INFO:teuthology.orchestra.run.smithi057.stdout:(2/36): ceph-mds-19.0.0-3227.g424d8c43.el9.x86_ 5.2 MB/s | 2.2 MB 00:00 2024-04-24T01:46:16.869 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-24T01:46:16.906 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-24T01:46:16.939 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-24T01:46:17.031 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-24T01:46:17.098 INFO:teuthology.orchestra.run.smithi057.stdout:(3/36): ceph-mgr-19.0.0-3227.g424d8c43.el9.x86_ 2.2 MB/s | 1.6 MB 00:00 2024-04-24T01:46:17.104 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-24T01:46:17.150 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-24T01:46:17.185 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-24T01:46:17.198 INFO:teuthology.orchestra.run.smithi057.stdout:(4/36): ceph-mgr-modules-core-19.0.0-3227.g424d 2.4 MB/s | 249 kB 00:00 2024-04-24T01:46:17.215 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-24T01:46:17.241 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-04-24T01:46:17.266 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-04-24T01:46:17.306 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-04-24T01:46:17.350 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-04-24T01:46:17.384 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-04-24T01:46:17.422 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-04-24T01:46:17.495 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-04-24T01:46:17.658 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-04-24T01:46:17.739 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-04-24T01:46:17.800 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-04-24T01:46:17.839 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-04-24T01:46:17.887 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-04-24T01:46:17.942 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-04-24T01:46:18.128 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-04-24T01:46:18.157 INFO:teuthology.orchestra.run.smithi057.stdout:(5/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 264 kB/s | 253 kB 00:00 2024-04-24T01:46:18.184 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-04-24T01:46:18.223 INFO:teuthology.orchestra.run.smithi057.stdout:(6/36): ceph-mon-19.0.0-3227.g424d8c43.el9.x86_ 3.1 MB/s | 5.0 MB 00:01 2024-04-24T01:46:18.262 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-04-24T01:46:18.351 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-04-24T01:46:18.392 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-04-24T01:46:18.507 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-04-24T01:46:18.691 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3227.g424d8c43.el9. 31/36 2024-04-24T01:46:18.719 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-2:19.0.0-3227.g424d8c43.el9.x86_64 32/36 2024-04-24T01:46:18.743 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3227.g424d8c43.el9.x86_64 32/36 2024-04-24T01:46:18.743 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:46:18.743 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-24T01:46:18.743 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-24T01:46:18.743 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-24T01:46:18.743 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:46:19.074 INFO:teuthology.orchestra.run.smithi057.stdout:(7/36): python3-ply-3.11-14.el9.noarch.rpm 125 kB/s | 106 kB 00:00 2024-04-24T01:46:20.116 INFO:teuthology.orchestra.run.smithi057.stdout:(8/36): ceph-osd-19.0.0-3227.g424d8c43.el9.x86_ 21 MB/s | 71 MB 00:03 2024-04-24T01:46:20.499 INFO:teuthology.orchestra.run.smithi057.stdout:(9/36): python3-pycparser-2.20-6.el9.noarch.rpm 95 kB/s | 135 kB 00:01 2024-04-24T01:46:20.591 INFO:teuthology.orchestra.run.smithi057.stdout:(10/36): python3-cryptography-36.0.1-4.el9.x86_ 516 kB/s | 1.2 MB 00:02 2024-04-24T01:46:20.733 INFO:teuthology.orchestra.run.smithi057.stdout:(11/36): lua-5.4.4-4.el9.x86_64.rpm 1.3 MB/s | 188 kB 00:00 2024-04-24T01:46:20.800 INFO:teuthology.orchestra.run.smithi057.stdout:(12/36): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-04-24T01:46:20.908 INFO:teuthology.orchestra.run.smithi057.stdout:(13/36): python3-requests-2.25.1-8.el9.noarch.r 158 kB/s | 125 kB 00:00 2024-04-24T01:46:20.934 INFO:teuthology.orchestra.run.smithi057.stdout:(14/36): python3-markupsafe-1.1.1-12.el9.x86_64 260 kB/s | 35 kB 00:00 2024-04-24T01:46:20.984 INFO:teuthology.orchestra.run.smithi057.stdout:(15/36): python3-toml-0.10.2-6.el9.noarch.rpm 835 kB/s | 42 kB 00:00 2024-04-24T01:46:21.018 INFO:teuthology.orchestra.run.smithi057.stdout:(16/36): python3-pytz-2021.1-5.el9.noarch.rpm 468 kB/s | 51 kB 00:00 2024-04-24T01:46:21.127 INFO:teuthology.orchestra.run.smithi057.stdout:(17/36): luarocks-3.9.2-1.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-04-24T01:46:21.152 INFO:teuthology.orchestra.run.smithi057.stdout:(18/36): lua-devel-5.4.4-4.el9.x86_64.rpm 133 kB/s | 22 kB 00:00 2024-04-24T01:46:21.185 INFO:teuthology.orchestra.run.smithi057.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 741 kB/s | 43 kB 00:00 2024-04-24T01:46:21.244 INFO:teuthology.orchestra.run.smithi057.stdout:(20/36): python3-cherrypy-18.6.1-2.el9.noarch.r 6.0 MB/s | 358 kB 00:00 2024-04-24T01:46:21.269 INFO:teuthology.orchestra.run.smithi057.stdout:(21/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-04-24T01:46:21.294 INFO:teuthology.orchestra.run.smithi057.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 212 kB/s | 11 kB 00:00 2024-04-24T01:46:21.320 INFO:teuthology.orchestra.run.smithi057.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 352 kB/s | 18 kB 00:00 2024-04-24T01:46:21.345 INFO:teuthology.orchestra.run.smithi057.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 462 kB/s | 23 kB 00:00 2024-04-24T01:46:21.370 INFO:teuthology.orchestra.run.smithi057.stdout:(25/36): python3-jaraco-functools-3.5.0-2.el9.n 389 kB/s | 19 kB 00:00 2024-04-24T01:46:21.396 INFO:teuthology.orchestra.run.smithi057.stdout:(26/36): python3-jaraco-text-3.2.0-6.el9.noarch 390 kB/s | 20 kB 00:00 2024-04-24T01:46:21.421 INFO:teuthology.orchestra.run.smithi057.stdout:(27/36): python3-logutils-0.3.5-21.el9.noarch.r 922 kB/s | 46 kB 00:00 2024-04-24T01:46:21.446 INFO:teuthology.orchestra.run.smithi057.stdout:(28/36): python3-urllib3-1.26.5-5.el9.noarch.rp 227 kB/s | 215 kB 00:00 2024-04-24T01:46:21.471 INFO:teuthology.orchestra.run.smithi057.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-04-24T01:46:21.497 INFO:teuthology.orchestra.run.smithi057.stdout:(30/36): python3-pecan-1.4.2-3.el9.noarch.rpm 3.6 MB/s | 272 kB 00:00 2024-04-24T01:46:21.522 INFO:teuthology.orchestra.run.smithi057.stdout:(31/36): python3-portend-3.1.0-2.el9.noarch.rpm 217 kB/s | 16 kB 00:00 2024-04-24T01:46:21.547 INFO:teuthology.orchestra.run.smithi057.stdout:(32/36): python3-tempora-5.0.0-2.el9.noarch.rpm 714 kB/s | 36 kB 00:00 2024-04-24T01:46:21.572 INFO:teuthology.orchestra.run.smithi057.stdout:(33/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 893 kB/s | 90 kB 00:00 2024-04-24T01:46:21.615 INFO:teuthology.orchestra.run.smithi057.stdout:(34/36): python3-zc-lockfile-2.0-10.el9.noarch. 480 kB/s | 20 kB 00:00 2024-04-24T01:46:21.648 INFO:teuthology.orchestra.run.smithi057.stdout:(35/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-04-24T01:46:21.673 INFO:teuthology.orchestra.run.smithi057.stdout:(36/36): python3-webob-1.8.7-6.el9.noarch.rpm 1.5 MB/s | 230 kB 00:00 2024-04-24T01:46:21.676 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:46:21.676 INFO:teuthology.orchestra.run.smithi057.stdout:Total 13 MB/s | 84 MB 00:06 2024-04-24T01:46:21.816 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-04-24T01:46:21.863 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-04-24T01:46:21.863 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-04-24T01:46:22.510 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-04-24T01:46:22.510 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-04-24T01:46:24.112 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-04-24T01:46:24.167 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-04-24T01:46:24.201 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-04-24T01:46:24.228 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-04-24T01:46:24.295 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-04-24T01:46:24.336 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-04-24T01:46:24.369 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-04-24T01:46:24.466 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-04-24T01:46:24.542 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-04-24T01:46:24.588 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-04-24T01:46:24.639 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-04-24T01:46:24.669 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/36 2024-04-24T01:46:24.704 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/36 2024-04-24T01:46:24.737 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/36 2024-04-24T01:46:24.778 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/36 2024-04-24T01:46:24.821 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/36 2024-04-24T01:46:24.854 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/36 2024-04-24T01:46:24.893 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/36 2024-04-24T01:46:24.970 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 18/36 2024-04-24T01:46:25.124 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 19/36 2024-04-24T01:46:25.213 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 20/36 2024-04-24T01:46:25.272 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 21/36 2024-04-24T01:46:25.310 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 22/36 2024-04-24T01:46:25.369 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ply-3.11-14.el9.noarch 23/36 2024-04-24T01:46:25.432 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 24/36 2024-04-24T01:46:25.630 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 25/36 2024-04-24T01:46:25.680 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 26/36 2024-04-24T01:46:25.762 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 27/36 2024-04-24T01:46:25.860 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 28/36 2024-04-24T01:46:25.896 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 29/36 2024-04-24T01:46:26.018 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 30/36 2024-04-24T01:46:26.212 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3227.g424d8c43.el9. 31/36 2024-04-24T01:46:26.238 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-2:19.0.0-3227.g424d8c43.el9.x86_64 32/36 2024-04-24T01:46:26.265 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3227.g424d8c43.el9.x86_64 32/36 2024-04-24T01:46:26.265 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:46:26.265 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-24T01:46:26.265 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-24T01:46:26.265 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-24T01:46:26.265 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:46:29.518 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-osd-2:19.0.0-3227.g424d8c43.el9.x86_64 33/36 2024-04-24T01:46:29.544 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-osd-2:19.0.0-3227.g424d8c43.el9.x86_64 33/36 2024-04-24T01:46:29.544 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:46:29.544 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-24T01:46:29.544 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-24T01:46:29.544 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-24T01:46:29.544 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:46:30.094 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mon-2:19.0.0-3227.g424d8c43.el9.x86_64 34/36 2024-04-24T01:46:30.117 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mon-2:19.0.0-3227.g424d8c43.el9.x86_64 34/36 2024-04-24T01:46:30.117 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:46:30.117 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-24T01:46:30.117 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-24T01:46:30.117 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-24T01:46:30.117 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:46:30.370 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mds-2:19.0.0-3227.g424d8c43.el9.x86_64 35/36 2024-04-24T01:46:30.391 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mds-2:19.0.0-3227.g424d8c43.el9.x86_64 35/36 2024-04-24T01:46:30.391 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:46:30.391 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-24T01:46:30.391 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-24T01:46:30.391 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-24T01:46:30.391 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:46:30.459 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-2:19.0.0-3227.g424d8c43.el9.x86_64 36/36 2024-04-24T01:46:36.964 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-2:19.0.0-3227.g424d8c43.el9.x86_64 36/36 2024-04-24T01:46:36.965 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-2:19.0.0-3227.g424d8c43.el9.x86_64 1/36 2024-04-24T01:46:36.965 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mds-2:19.0.0-3227.g424d8c43.el9.x86_64 2/36 2024-04-24T01:46:36.965 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-2:19.0.0-3227.g424d8c43.el9.x86_64 3/36 2024-04-24T01:46:36.965 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mon-2:19.0.0-3227.g424d8c43.el9.x86_64 4/36 2024-04-24T01:46:36.965 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-osd-2:19.0.0-3227.g424d8c43.el9.x86_64 5/36 2024-04-24T01:46:36.965 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3227.g424d8c43.el9. 6/36 2024-04-24T01:46:36.965 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-04-24T01:46:36.965 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-04-24T01:46:36.965 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-04-24T01:46:36.966 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-04-24T01:46:36.966 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-04-24T01:46:36.966 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-04-24T01:46:36.966 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-04-24T01:46:36.966 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-04-24T01:46:36.966 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-04-24T01:46:36.966 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-04-24T01:46:36.966 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-04-24T01:46:36.966 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-24T01:46:36.966 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-24T01:46:36.966 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-24T01:46:36.967 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-24T01:46:36.967 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-24T01:46:36.967 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-24T01:46:36.967 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-24T01:46:36.967 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-24T01:46:36.968 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-24T01:46:36.968 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-24T01:46:36.968 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-24T01:46:36.968 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-24T01:46:36.969 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-24T01:46:36.969 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-24T01:46:36.969 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-24T01:46:36.969 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-24T01:46:36.969 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-24T01:46:36.969 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-24T01:46:37.721 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-osd-2:19.0.0-3227.g424d8c43.el9.x86_64 33/36 2024-04-24T01:46:37.749 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-osd-2:19.0.0-3227.g424d8c43.el9.x86_64 33/36 2024-04-24T01:46:37.749 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:46:37.749 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-24T01:46:37.749 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-24T01:46:37.750 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-24T01:46:37.750 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:46:37.854 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-24T01:46:37.855 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:46:37.855 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-24T01:46:37.855 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:46:37.855 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mds-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:46:37.855 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:46:37.855 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-modules-core-2:19.0.0-3227.g424d8c43.el9.noarch 2024-04-24T01:46:37.855 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mon-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:46:37.855 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-osd-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:46:37.855 INFO:teuthology.orchestra.run.smithi084.stdout: lua-5.4.4-4.el9.x86_64 2024-04-24T01:46:37.855 INFO:teuthology.orchestra.run.smithi084.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-24T01:46:37.855 INFO:teuthology.orchestra.run.smithi084.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-24T01:46:37.855 INFO:teuthology.orchestra.run.smithi084.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-24T01:46:37.855 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-24T01:46:37.856 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-24T01:46:37.856 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-24T01:46:37.856 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-24T01:46:37.856 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-24T01:46:37.856 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-24T01:46:37.856 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-24T01:46:37.856 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-24T01:46:37.856 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-24T01:46:37.856 INFO:teuthology.orchestra.run.smithi084.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-24T01:46:37.856 INFO:teuthology.orchestra.run.smithi084.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-24T01:46:37.856 INFO:teuthology.orchestra.run.smithi084.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-24T01:46:37.856 INFO:teuthology.orchestra.run.smithi084.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-24T01:46:37.856 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-24T01:46:37.856 INFO:teuthology.orchestra.run.smithi084.stdout: python3-ply-3.11-14.el9.noarch 2024-04-24T01:46:37.856 INFO:teuthology.orchestra.run.smithi084.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-24T01:46:37.857 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-24T01:46:37.857 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-24T01:46:37.857 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-24T01:46:37.857 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-24T01:46:37.857 INFO:teuthology.orchestra.run.smithi084.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-24T01:46:37.857 INFO:teuthology.orchestra.run.smithi084.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-24T01:46:37.857 INFO:teuthology.orchestra.run.smithi084.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-24T01:46:37.857 INFO:teuthology.orchestra.run.smithi084.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-24T01:46:37.857 INFO:teuthology.orchestra.run.smithi084.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-24T01:46:37.857 INFO:teuthology.orchestra.run.smithi084.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-24T01:46:37.857 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:46:37.857 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-24T01:46:38.209 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-base 2024-04-24T01:46:38.314 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mon-2:19.0.0-3227.g424d8c43.el9.x86_64 34/36 2024-04-24T01:46:38.338 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mon-2:19.0.0-3227.g424d8c43.el9.x86_64 34/36 2024-04-24T01:46:38.338 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:46:38.338 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-24T01:46:38.338 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-24T01:46:38.338 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-24T01:46:38.338 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:46:38.581 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mds-2:19.0.0-3227.g424d8c43.el9.x86_64 35/36 2024-04-24T01:46:38.605 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mds-2:19.0.0-3227.g424d8c43.el9.x86_64 35/36 2024-04-24T01:46:38.605 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:46:38.605 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-24T01:46:38.605 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-24T01:46:38.605 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-24T01:46:38.605 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:46:38.672 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-2:19.0.0-3227.g424d8c43.el9.x86_64 36/36 2024-04-24T01:46:38.721 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:26 ago on Wed 24 Apr 2024 01:45:12 AM UTC. 2024-04-24T01:46:38.801 INFO:teuthology.orchestra.run.smithi084.stdout:Package ceph-base-2:19.0.0-3227.g424d8c43.el9.x86_64 is already installed. 2024-04-24T01:46:38.843 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-24T01:46:38.844 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-04-24T01:46:38.844 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-24T01:46:38.920 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install cephadm 2024-04-24T01:46:39.428 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:27 ago on Wed 24 Apr 2024 01:45:12 AM UTC. 2024-04-24T01:46:39.548 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-24T01:46:39.549 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:46:39.549 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-04-24T01:46:39.549 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:46:39.549 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-24T01:46:39.549 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm noarch 2:19.0.0-3227.g424d8c43.el9 ceph-noarch 762 k 2024-04-24T01:46:39.549 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:46:39.549 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-24T01:46:39.549 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:46:39.549 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2024-04-24T01:46:39.550 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:46:39.550 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 762 k 2024-04-24T01:46:39.550 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 769 k 2024-04-24T01:46:39.550 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-24T01:46:39.877 INFO:teuthology.orchestra.run.smithi084.stdout:cephadm-19.0.0-3227.g424d8c43.el9.noarch.rpm 2.3 MB/s | 762 kB 00:00 2024-04-24T01:46:39.878 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:46:39.878 INFO:teuthology.orchestra.run.smithi084.stdout:Total 2.3 MB/s | 762 kB 00:00 2024-04-24T01:46:39.878 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-24T01:46:39.883 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-24T01:46:39.884 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-24T01:46:39.889 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-24T01:46:39.890 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-24T01:46:39.963 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-24T01:46:40.378 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephadm-2:19.0.0-3227.g424d8c43.el9.noarch 1/1 2024-04-24T01:46:40.455 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : cephadm-2:19.0.0-3227.g424d8c43.el9.noarch 1/1 2024-04-24T01:46:40.780 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: cephadm-2:19.0.0-3227.g424d8c43.el9.noarch 1/1 2024-04-24T01:46:41.041 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : cephadm-2:19.0.0-3227.g424d8c43.el9.noarch 1/1 2024-04-24T01:46:41.041 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:46:41.041 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-24T01:46:41.041 INFO:teuthology.orchestra.run.smithi084.stdout: cephadm-2:19.0.0-3227.g424d8c43.el9.noarch 2024-04-24T01:46:41.041 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:46:41.041 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-24T01:46:41.280 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-immutable-object-cache 2024-04-24T01:46:41.801 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:29 ago on Wed 24 Apr 2024 01:45:12 AM UTC. 2024-04-24T01:46:41.923 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-24T01:46:41.923 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:46:41.923 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repo Size 2024-04-24T01:46:41.923 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:46:41.923 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-24T01:46:41.923 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 157 k 2024-04-24T01:46:41.923 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:46:41.923 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-24T01:46:41.924 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:46:41.924 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2024-04-24T01:46:41.924 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:46:41.924 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 157 k 2024-04-24T01:46:41.924 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 640 k 2024-04-24T01:46:41.924 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-24T01:46:42.283 INFO:teuthology.orchestra.run.smithi084.stdout:ceph-immutable-object-cache-19.0.0-3227.g424d8c 438 kB/s | 157 kB 00:00 2024-04-24T01:46:42.284 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:46:42.284 INFO:teuthology.orchestra.run.smithi084.stdout:Total 436 kB/s | 157 kB 00:00 2024-04-24T01:46:42.284 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-24T01:46:42.294 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-24T01:46:42.294 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-24T01:46:42.350 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-24T01:46:42.350 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-24T01:46:42.500 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-24T01:46:42.576 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3227.g424d8c43. 1/1 2024-04-24T01:46:42.602 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3227.g424d8c43. 1/1 2024-04-24T01:46:42.602 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:46:42.602 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-24T01:46:42.602 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:46:43.478 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3227.g424d8c43. 1/1 2024-04-24T01:46:43.478 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:46:43.478 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-24T01:46:43.478 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-immutable-object-cache-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:46:43.478 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:46:43.478 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-24T01:46:43.702 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-mgr 2024-04-24T01:46:44.219 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:32 ago on Wed 24 Apr 2024 01:45:12 AM UTC. 2024-04-24T01:46:44.301 INFO:teuthology.orchestra.run.smithi084.stdout:Package ceph-mgr-2:19.0.0-3227.g424d8c43.el9.x86_64 is already installed. 2024-04-24T01:46:44.344 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-24T01:46:44.345 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-04-24T01:46:44.345 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-24T01:46:44.416 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-mgr-dashboard 2024-04-24T01:46:44.919 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:32 ago on Wed 24 Apr 2024 01:45:12 AM UTC. 2024-04-24T01:46:45.038 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-24T01:46:45.039 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:46:45.040 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-04-24T01:46:45.040 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:46:45.040 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-24T01:46:45.040 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3227.g424d8c43.el9 ceph-noarch 3.5 M 2024-04-24T01:46:45.040 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-04-24T01:46:45.040 INFO:teuthology.orchestra.run.smithi084.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-24T01:46:45.040 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3227.g424d8c43.el9 ceph-noarch 34 k 2024-04-24T01:46:45.040 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3227.g424d8c43.el9 ceph-noarch 16 k 2024-04-24T01:46:45.040 INFO:teuthology.orchestra.run.smithi084.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-24T01:46:45.040 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-24T01:46:45.040 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-24T01:46:45.041 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-24T01:46:45.041 INFO:teuthology.orchestra.run.smithi084.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-24T01:46:45.041 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-24T01:46:45.041 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-24T01:46:45.041 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:46:45.041 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-24T01:46:45.041 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:46:45.041 INFO:teuthology.orchestra.run.smithi084.stdout:Install 11 Packages 2024-04-24T01:46:45.041 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:46:45.042 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 7.6 M 2024-04-24T01:46:45.042 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 100 M 2024-04-24T01:46:45.042 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-24T01:46:45.387 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-2:19.0.0-3227.g424d8c43.el9.x86_64 36/36 2024-04-24T01:46:45.387 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-2:19.0.0-3227.g424d8c43.el9.x86_64 1/36 2024-04-24T01:46:45.388 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mds-2:19.0.0-3227.g424d8c43.el9.x86_64 2/36 2024-04-24T01:46:45.388 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-2:19.0.0-3227.g424d8c43.el9.x86_64 3/36 2024-04-24T01:46:45.388 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mon-2:19.0.0-3227.g424d8c43.el9.x86_64 4/36 2024-04-24T01:46:45.388 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-osd-2:19.0.0-3227.g424d8c43.el9.x86_64 5/36 2024-04-24T01:46:45.388 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3227.g424d8c43.el9. 6/36 2024-04-24T01:46:45.388 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/36 2024-04-24T01:46:45.388 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/36 2024-04-24T01:46:45.388 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/36 2024-04-24T01:46:45.388 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/36 2024-04-24T01:46:45.388 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/36 2024-04-24T01:46:45.388 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/36 2024-04-24T01:46:45.388 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/36 2024-04-24T01:46:45.388 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/36 2024-04-24T01:46:45.389 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/36 2024-04-24T01:46:45.389 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/36 2024-04-24T01:46:45.389 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/36 2024-04-24T01:46:45.389 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-04-24T01:46:45.389 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-04-24T01:46:45.389 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-04-24T01:46:45.389 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-04-24T01:46:45.389 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-04-24T01:46:45.389 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-04-24T01:46:45.389 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-04-24T01:46:45.389 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-04-24T01:46:45.389 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-04-24T01:46:45.389 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-04-24T01:46:45.390 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-04-24T01:46:45.390 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-04-24T01:46:45.390 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-04-24T01:46:45.390 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-04-24T01:46:45.390 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-04-24T01:46:45.390 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-04-24T01:46:45.390 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-04-24T01:46:45.390 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-04-24T01:46:45.620 INFO:teuthology.orchestra.run.smithi084.stdout:(1/11): ceph-grafana-dashboards-19.0.0-3227.g42 164 kB/s | 34 kB 00:00 2024-04-24T01:46:45.720 INFO:teuthology.orchestra.run.smithi084.stdout:(2/11): ceph-prometheus-alerts-19.0.0-3227.g424 53 kB/s | 16 kB 00:00 2024-04-24T01:46:46.195 INFO:teuthology.orchestra.run.smithi084.stdout:(3/11): python3-protobuf-3.14.0-13.el9.noarch.r 468 kB/s | 269 kB 00:00 2024-04-24T01:46:46.253 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-04-24T01:46:46.253 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:46:46.253 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-04-24T01:46:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:46:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:46:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:46:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core-2:19.0.0-3227.g424d8c43.el9.noarch 2024-04-24T01:46:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:46:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:46:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: lua-5.4.4-4.el9.x86_64 2024-04-24T01:46:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-24T01:46:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-24T01:46:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-24T01:46:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-24T01:46:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-24T01:46:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-24T01:46:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-24T01:46:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-24T01:46:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-24T01:46:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-24T01:46:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-24T01:46:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-24T01:46:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-24T01:46:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-24T01:46:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-24T01:46:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-24T01:46:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-24T01:46:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ply-3.11-14.el9.noarch 2024-04-24T01:46:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-24T01:46:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-24T01:46:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-24T01:46:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-24T01:46:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-24T01:46:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-24T01:46:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-24T01:46:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-24T01:46:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-24T01:46:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-24T01:46:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-24T01:46:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:46:46.256 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-24T01:46:46.496 INFO:teuthology.orchestra.run.smithi084.stdout:(4/11): protobuf-compiler-3.14.0-13.el9.x86_64. 1.1 MB/s | 863 kB 00:00 2024-04-24T01:46:46.529 INFO:teuthology.orchestra.run.smithi084.stdout:(5/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 1.6 MB/s | 548 kB 00:00 2024-04-24T01:46:46.555 INFO:teuthology.orchestra.run.smithi084.stdout:(6/11): grpc-data-1.46.7-10.el9.noarch.rpm 331 kB/s | 19 kB 00:00 2024-04-24T01:46:46.582 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-base 2024-04-24T01:46:46.705 INFO:teuthology.orchestra.run.smithi084.stdout:(7/11): ceph-mgr-dashboard-19.0.0-3227.g424d8c4 2.7 MB/s | 3.5 MB 00:01 2024-04-24T01:46:46.813 INFO:teuthology.orchestra.run.smithi084.stdout:(8/11): python3-grpcio-1.46.7-10.el9.x86_64.rpm 7.2 MB/s | 2.0 MB 00:00 2024-04-24T01:46:46.839 INFO:teuthology.orchestra.run.smithi084.stdout:(9/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 510 kB/s | 144 kB 00:00 2024-04-24T01:46:46.864 INFO:teuthology.orchestra.run.smithi084.stdout:(10/11): python3-repoze-lru-0.7-16.el9.noarch.r 195 kB/s | 31 kB 00:00 2024-04-24T01:46:46.889 INFO:teuthology.orchestra.run.smithi084.stdout:(11/11): python3-routes-2.5.1-5.el9.noarch.rpm 2.5 MB/s | 188 kB 00:00 2024-04-24T01:46:46.891 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:46:46.891 INFO:teuthology.orchestra.run.smithi084.stdout:Total 4.1 MB/s | 7.6 MB 00:01 2024-04-24T01:46:46.921 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-24T01:46:46.937 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-24T01:46:46.937 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-24T01:46:47.083 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-24T01:46:47.083 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-24T01:46:47.121 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:28 ago on Wed 24 Apr 2024 01:45:19 AM UTC. 2024-04-24T01:46:47.203 INFO:teuthology.orchestra.run.smithi057.stdout:Package ceph-base-2:19.0.0-3227.g424d8c43.el9.x86_64 is already installed. 2024-04-24T01:46:47.247 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-24T01:46:47.248 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-04-24T01:46:47.248 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-24T01:46:47.311 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install cephadm 2024-04-24T01:46:47.572 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-24T01:46:47.662 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-04-24T01:46:47.692 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-04-24T01:46:47.769 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-04-24T01:46:47.848 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:28 ago on Wed 24 Apr 2024 01:45:19 AM UTC. 2024-04-24T01:46:47.898 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-04-24T01:46:47.954 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-04-24T01:46:47.974 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-24T01:46:47.975 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:46:47.975 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-04-24T01:46:47.975 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:46:47.975 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-04-24T01:46:47.975 INFO:teuthology.orchestra.run.smithi057.stdout: cephadm noarch 2:19.0.0-3227.g424d8c43.el9 ceph-noarch 762 k 2024-04-24T01:46:47.976 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:46:47.976 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-24T01:46:47.976 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:46:47.976 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2024-04-24T01:46:47.976 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:46:47.976 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 762 k 2024-04-24T01:46:47.976 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 769 k 2024-04-24T01:46:47.976 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-04-24T01:46:48.038 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-04-24T01:46:48.089 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-04-24T01:46:48.118 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-04-24T01:46:48.150 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3227.g424d8c43.el9 9/11 2024-04-24T01:46:48.422 INFO:teuthology.orchestra.run.smithi057.stdout:cephadm-19.0.0-3227.g424d8c43.el9.noarch.rpm 1.7 MB/s | 762 kB 00:00 2024-04-24T01:46:48.423 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:46:48.423 INFO:teuthology.orchestra.run.smithi057.stdout:Total 1.7 MB/s | 762 kB 00:00 2024-04-24T01:46:48.423 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-04-24T01:46:48.429 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-04-24T01:46:48.429 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-04-24T01:46:48.435 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-04-24T01:46:48.435 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-04-24T01:46:48.512 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-04-24T01:46:48.996 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: cephadm-2:19.0.0-3227.g424d8c43.el9.noarch 1/1 2024-04-24T01:46:49.087 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : cephadm-2:19.0.0-3227.g424d8c43.el9.noarch 1/1 2024-04-24T01:46:49.202 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3227.g424d8c43.el 10/11 2024-04-24T01:46:49.242 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3227.g424d8c43.el9.noa 11/11 2024-04-24T01:46:49.429 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: cephadm-2:19.0.0-3227.g424d8c43.el9.noarch 1/1 2024-04-24T01:46:49.677 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cephadm-2:19.0.0-3227.g424d8c43.el9.noarch 1/1 2024-04-24T01:46:49.677 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:46:49.677 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-04-24T01:46:49.677 INFO:teuthology.orchestra.run.smithi057.stdout: cephadm-2:19.0.0-3227.g424d8c43.el9.noarch 2024-04-24T01:46:49.677 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:46:49.677 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-24T01:46:49.911 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-immutable-object-cache 2024-04-24T01:46:50.449 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:31 ago on Wed 24 Apr 2024 01:45:19 AM UTC. 2024-04-24T01:46:50.454 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3227.g424d8c43.el9.noa 11/11 2024-04-24T01:46:50.454 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3227.g424d8c43.el 1/11 2024-04-24T01:46:50.454 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3227.g424d8c43.el9.noa 2/11 2024-04-24T01:46:50.454 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3227.g424d8c43.el9 3/11 2024-04-24T01:46:50.454 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-04-24T01:46:50.454 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-04-24T01:46:50.454 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-04-24T01:46:50.454 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-04-24T01:46:50.455 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-04-24T01:46:50.455 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-04-24T01:46:50.455 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-04-24T01:46:50.575 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-24T01:46:50.576 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:46:50.576 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repo Size 2024-04-24T01:46:50.577 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:46:50.577 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-04-24T01:46:50.577 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 157 k 2024-04-24T01:46:50.577 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:46:50.577 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-24T01:46:50.577 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:46:50.577 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2024-04-24T01:46:50.577 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:46:50.577 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 157 k 2024-04-24T01:46:50.577 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 640 k 2024-04-24T01:46:50.577 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-04-24T01:46:50.735 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-04-24T01:46:50.735 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:46:50.735 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-24T01:46:50.736 INFO:teuthology.orchestra.run.smithi084.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-24T01:46:50.736 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-grafana-dashboards-2:19.0.0-3227.g424d8c43.el9.noarch 2024-04-24T01:46:50.736 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-dashboard-2:19.0.0-3227.g424d8c43.el9.noarch 2024-04-24T01:46:50.736 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-prometheus-alerts-2:19.0.0-3227.g424d8c43.el9.noarch 2024-04-24T01:46:50.736 INFO:teuthology.orchestra.run.smithi084.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-24T01:46:50.736 INFO:teuthology.orchestra.run.smithi084.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-24T01:46:50.736 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-24T01:46:50.736 INFO:teuthology.orchestra.run.smithi084.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-24T01:46:50.736 INFO:teuthology.orchestra.run.smithi084.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-24T01:46:50.736 INFO:teuthology.orchestra.run.smithi084.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-24T01:46:50.736 INFO:teuthology.orchestra.run.smithi084.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-24T01:46:50.736 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:46:50.736 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-24T01:46:50.991 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-24T01:46:51.078 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-immutable-object-cache-19.0.0-3227.g424d8c 314 kB/s | 157 kB 00:00 2024-04-24T01:46:51.079 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:46:51.079 INFO:teuthology.orchestra.run.smithi057.stdout:Total 312 kB/s | 157 kB 00:00 2024-04-24T01:46:51.079 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-04-24T01:46:51.090 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-04-24T01:46:51.090 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-04-24T01:46:51.154 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-04-24T01:46:51.154 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-04-24T01:46:51.316 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-04-24T01:46:51.387 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3227.g424d8c43. 1/1 2024-04-24T01:46:51.413 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3227.g424d8c43. 1/1 2024-04-24T01:46:51.413 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:46:51.413 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-24T01:46:51.413 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:46:51.498 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:01:39 ago on Wed 24 Apr 2024 01:45:12 AM UTC. 2024-04-24T01:46:51.619 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-24T01:46:51.620 INFO:teuthology.orchestra.run.smithi084.stdout:======================================================================================= 2024-04-24T01:46:51.620 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-04-24T01:46:51.620 INFO:teuthology.orchestra.run.smithi084.stdout:======================================================================================= 2024-04-24T01:46:51.620 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-24T01:46:51.620 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3227.g424d8c43.el9 ceph-noarch 7.4 M 2024-04-24T01:46:51.620 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-04-24T01:46:51.620 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-24T01:46:51.620 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-24T01:46:51.620 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-24T01:46:51.620 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-24T01:46:51.621 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-24T01:46:51.621 INFO:teuthology.orchestra.run.smithi084.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-24T01:46:51.621 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-24T01:46:51.621 INFO:teuthology.orchestra.run.smithi084.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-24T01:46:51.621 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-24T01:46:51.621 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-24T01:46:51.621 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-24T01:46:51.621 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:46:51.621 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-24T01:46:51.621 INFO:teuthology.orchestra.run.smithi084.stdout:======================================================================================= 2024-04-24T01:46:51.621 INFO:teuthology.orchestra.run.smithi084.stdout:Install 12 Packages 2024-04-24T01:46:51.621 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:46:51.622 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 38 M 2024-04-24T01:46:51.622 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 209 M 2024-04-24T01:46:51.622 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-24T01:46:52.187 INFO:teuthology.orchestra.run.smithi084.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-04-24T01:46:52.262 INFO:teuthology.orchestra.run.smithi084.stdout:(2/12): libgfortran-11.4.1-3.el9.x86_64.rpm 3.1 MB/s | 803 kB 00:00 2024-04-24T01:46:52.328 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3227.g424d8c43. 1/1 2024-04-24T01:46:52.328 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:46:52.328 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-04-24T01:46:52.328 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-immutable-object-cache-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:46:52.328 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:46:52.328 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-24T01:46:52.548 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-mgr 2024-04-24T01:46:52.680 INFO:teuthology.orchestra.run.smithi084.stdout:(3/12): ceph-mgr-diskprediction-local-19.0.0-32 11 MB/s | 7.4 MB 00:00 2024-04-24T01:46:52.905 INFO:teuthology.orchestra.run.smithi084.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 46 kB/s | 33 kB 00:00 2024-04-24T01:46:53.088 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:34 ago on Wed 24 Apr 2024 01:45:19 AM UTC. 2024-04-24T01:46:53.170 INFO:teuthology.orchestra.run.smithi057.stdout:Package ceph-mgr-2:19.0.0-3227.g424d8c43.el9.x86_64 is already installed. 2024-04-24T01:46:53.214 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-24T01:46:53.215 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-04-24T01:46:53.215 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-24T01:46:53.278 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-mgr-dashboard 2024-04-24T01:46:53.288 INFO:teuthology.orchestra.run.smithi084.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 30 kB/s | 18 kB 00:00 2024-04-24T01:46:53.605 INFO:teuthology.orchestra.run.smithi084.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 50 kB/s | 35 kB 00:00 2024-04-24T01:46:53.810 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:34 ago on Wed 24 Apr 2024 01:45:19 AM UTC. 2024-04-24T01:46:53.936 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-24T01:46:53.937 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:46:53.937 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-04-24T01:46:53.937 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:46:53.937 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-04-24T01:46:53.937 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3227.g424d8c43.el9 ceph-noarch 3.5 M 2024-04-24T01:46:53.938 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-04-24T01:46:53.938 INFO:teuthology.orchestra.run.smithi057.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-24T01:46:53.938 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3227.g424d8c43.el9 ceph-noarch 34 k 2024-04-24T01:46:53.938 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3227.g424d8c43.el9 ceph-noarch 16 k 2024-04-24T01:46:53.938 INFO:teuthology.orchestra.run.smithi057.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-24T01:46:53.938 INFO:teuthology.orchestra.run.smithi057.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-24T01:46:53.938 INFO:teuthology.orchestra.run.smithi057.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-24T01:46:53.938 INFO:teuthology.orchestra.run.smithi057.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-24T01:46:53.938 INFO:teuthology.orchestra.run.smithi057.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-24T01:46:53.938 INFO:teuthology.orchestra.run.smithi057.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-24T01:46:53.938 INFO:teuthology.orchestra.run.smithi057.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-24T01:46:53.938 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:46:53.938 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-24T01:46:53.938 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:46:53.939 INFO:teuthology.orchestra.run.smithi057.stdout:Install 11 Packages 2024-04-24T01:46:53.939 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:46:53.939 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 7.6 M 2024-04-24T01:46:53.939 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 100 M 2024-04-24T01:46:53.939 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-04-24T01:46:54.538 INFO:teuthology.orchestra.run.smithi084.stdout:(7/12): python3-devel-3.9.18-3.el9.x86_64.rpm 262 kB/s | 244 kB 00:00 2024-04-24T01:46:54.672 INFO:teuthology.orchestra.run.smithi057.stdout:(1/11): ceph-grafana-dashboards-19.0.0-3227.g42 169 kB/s | 34 kB 00:00 2024-04-24T01:46:54.697 INFO:teuthology.orchestra.run.smithi057.stdout:(2/11): ceph-prometheus-alerts-19.0.0-3227.g424 72 kB/s | 16 kB 00:00 2024-04-24T01:46:54.948 INFO:teuthology.orchestra.run.smithi057.stdout:(3/11): ceph-mgr-dashboard-19.0.0-3227.g424d8c4 7.4 MB/s | 3.5 MB 00:00 2024-04-24T01:46:55.131 INFO:teuthology.orchestra.run.smithi057.stdout:(4/11): protobuf-compiler-3.14.0-13.el9.x86_64. 1.9 MB/s | 863 kB 00:00 2024-04-24T01:46:55.282 INFO:teuthology.orchestra.run.smithi057.stdout:(5/11): python3-protobuf-3.14.0-13.el9.noarch.r 442 kB/s | 269 kB 00:00 2024-04-24T01:46:55.382 INFO:teuthology.orchestra.run.smithi057.stdout:(6/11): grpc-data-1.46.7-10.el9.noarch.rpm 78 kB/s | 19 kB 00:00 2024-04-24T01:46:55.449 INFO:teuthology.orchestra.run.smithi057.stdout:(7/11): abseil-cpp-20211102.0-3.el9.x86_64.rpm 1.1 MB/s | 548 kB 00:00 2024-04-24T01:46:55.525 INFO:teuthology.orchestra.run.smithi057.stdout:(8/11): python3-repoze-lru-0.7-16.el9.noarch.rp 409 kB/s | 31 kB 00:00 2024-04-24T01:46:55.583 INFO:teuthology.orchestra.run.smithi057.stdout:(9/11): python3-grpcio-tools-1.46.7-10.el9.x86_ 719 kB/s | 144 kB 00:00 2024-04-24T01:46:55.624 INFO:teuthology.orchestra.run.smithi057.stdout:(10/11): python3-routes-2.5.1-5.el9.noarch.rpm 1.8 MB/s | 188 kB 00:00 2024-04-24T01:46:55.833 INFO:teuthology.orchestra.run.smithi057.stdout:(11/11): python3-grpcio-1.46.7-10.el9.x86_64.rp 3.7 MB/s | 2.0 MB 00:00 2024-04-24T01:46:55.838 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:46:55.838 INFO:teuthology.orchestra.run.smithi057.stdout:Total 4.0 MB/s | 7.6 MB 00:01 2024-04-24T01:46:55.869 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-04-24T01:46:55.889 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-04-24T01:46:55.889 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-04-24T01:46:56.044 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-04-24T01:46:56.044 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-04-24T01:46:56.532 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-04-24T01:46:56.617 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 1/11 2024-04-24T01:46:56.645 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 2/11 2024-04-24T01:46:56.725 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 3/11 2024-04-24T01:46:56.859 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 4/11 2024-04-24T01:46:56.915 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 5/11 2024-04-24T01:46:56.930 INFO:teuthology.orchestra.run.smithi084.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 656 kB/s | 3.0 MB 00:04 2024-04-24T01:46:57.144 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 6/11 2024-04-24T01:46:57.193 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 7/11 2024-04-24T01:46:57.220 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 8/11 2024-04-24T01:46:57.252 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3227.g424d8c43.el9 9/11 2024-04-24T01:46:57.863 INFO:teuthology.orchestra.run.smithi084.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 269 kB/s | 250 kB 00:00 2024-04-24T01:46:58.347 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3227.g424d8c43.el 10/11 2024-04-24T01:46:58.386 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3227.g424d8c43.el9.noa 11/11 2024-04-24T01:46:59.492 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3227.g424d8c43.el9.noa 11/11 2024-04-24T01:46:59.493 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3227.g424d8c43.el 1/11 2024-04-24T01:46:59.493 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3227.g424d8c43.el9.noa 2/11 2024-04-24T01:46:59.493 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3227.g424d8c43.el9 3/11 2024-04-24T01:46:59.493 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 4/11 2024-04-24T01:46:59.493 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 5/11 2024-04-24T01:46:59.493 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 6/11 2024-04-24T01:46:59.493 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 7/11 2024-04-24T01:46:59.493 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 8/11 2024-04-24T01:46:59.493 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/11 2024-04-24T01:46:59.493 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 10/11 2024-04-24T01:46:59.811 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 11/11 2024-04-24T01:46:59.811 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:46:59.811 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-04-24T01:46:59.811 INFO:teuthology.orchestra.run.smithi057.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-24T01:46:59.811 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-grafana-dashboards-2:19.0.0-3227.g424d8c43.el9.noarch 2024-04-24T01:46:59.811 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard-2:19.0.0-3227.g424d8c43.el9.noarch 2024-04-24T01:46:59.811 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-prometheus-alerts-2:19.0.0-3227.g424d8c43.el9.noarch 2024-04-24T01:46:59.812 INFO:teuthology.orchestra.run.smithi057.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-24T01:46:59.812 INFO:teuthology.orchestra.run.smithi057.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-24T01:46:59.812 INFO:teuthology.orchestra.run.smithi057.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-24T01:46:59.812 INFO:teuthology.orchestra.run.smithi057.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-24T01:46:59.812 INFO:teuthology.orchestra.run.smithi057.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-24T01:46:59.812 INFO:teuthology.orchestra.run.smithi057.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-24T01:46:59.812 INFO:teuthology.orchestra.run.smithi057.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-24T01:46:59.812 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:46:59.812 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-24T01:47:00.052 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-mgr-diskprediction-local 2024-04-24T01:47:00.255 INFO:teuthology.orchestra.run.smithi084.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 697 kB/s | 4.7 MB 00:06 2024-04-24T01:47:00.580 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:41 ago on Wed 24 Apr 2024 01:45:19 AM UTC. 2024-04-24T01:47:00.706 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-24T01:47:00.708 INFO:teuthology.orchestra.run.smithi057.stdout:======================================================================================= 2024-04-24T01:47:00.708 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-04-24T01:47:00.708 INFO:teuthology.orchestra.run.smithi057.stdout:======================================================================================= 2024-04-24T01:47:00.708 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-04-24T01:47:00.708 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3227.g424d8c43.el9 ceph-noarch 7.4 M 2024-04-24T01:47:00.708 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-04-24T01:47:00.708 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-24T01:47:00.708 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-24T01:47:00.709 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-24T01:47:00.709 INFO:teuthology.orchestra.run.smithi057.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-24T01:47:00.709 INFO:teuthology.orchestra.run.smithi057.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-24T01:47:00.709 INFO:teuthology.orchestra.run.smithi057.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-24T01:47:00.709 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-24T01:47:00.709 INFO:teuthology.orchestra.run.smithi057.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-24T01:47:00.709 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-24T01:47:00.709 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-24T01:47:00.709 INFO:teuthology.orchestra.run.smithi057.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-24T01:47:00.709 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:00.709 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-24T01:47:00.709 INFO:teuthology.orchestra.run.smithi057.stdout:======================================================================================= 2024-04-24T01:47:00.709 INFO:teuthology.orchestra.run.smithi057.stdout:Install 12 Packages 2024-04-24T01:47:00.709 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:00.710 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 38 M 2024-04-24T01:47:00.710 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 209 M 2024-04-24T01:47:00.710 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-04-24T01:47:01.639 INFO:teuthology.orchestra.run.smithi057.stdout:(1/12): libquadmath-11.4.1-3.el9.x86_64.rpm 378 kB/s | 195 kB 00:00 2024-04-24T01:47:01.723 INFO:teuthology.orchestra.run.smithi057.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 393 kB/s | 33 kB 00:00 2024-04-24T01:47:01.746 INFO:teuthology.orchestra.run.smithi084.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 724 kB/s | 5.1 MB 00:07 2024-04-24T01:47:01.923 INFO:teuthology.orchestra.run.smithi057.stdout:(3/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 15 MB/s | 3.0 MB 00:00 2024-04-24T01:47:01.948 INFO:teuthology.orchestra.run.smithi057.stdout:(4/12): libgfortran-11.4.1-3.el9.x86_64.rpm 972 kB/s | 803 kB 00:00 2024-04-24T01:47:01.982 INFO:teuthology.orchestra.run.smithi057.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 311 kB/s | 18 kB 00:00 2024-04-24T01:47:02.024 INFO:teuthology.orchestra.run.smithi057.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 467 kB/s | 35 kB 00:00 2024-04-24T01:47:02.141 INFO:teuthology.orchestra.run.smithi057.stdout:(7/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 30 MB/s | 4.7 MB 00:00 2024-04-24T01:47:02.166 INFO:teuthology.orchestra.run.smithi057.stdout:(8/12): python3-devel-3.9.18-3.el9.x86_64.rpm 1.7 MB/s | 244 kB 00:00 2024-04-24T01:47:02.292 INFO:teuthology.orchestra.run.smithi057.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.0 MB/s | 250 kB 00:00 2024-04-24T01:47:02.375 INFO:teuthology.orchestra.run.smithi057.stdout:(10/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 22 MB/s | 5.1 MB 00:00 2024-04-24T01:47:02.501 INFO:teuthology.orchestra.run.smithi057.stdout:(11/12): ceph-mgr-diskprediction-local-19.0.0-3 5.4 MB/s | 7.4 MB 00:01 2024-04-24T01:47:03.001 INFO:teuthology.orchestra.run.smithi057.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-04-24T01:47:03.002 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:47:03.002 INFO:teuthology.orchestra.run.smithi057.stdout:Total 17 MB/s | 38 MB 00:02 2024-04-24T01:47:03.365 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-04-24T01:47:03.392 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-04-24T01:47:03.392 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-04-24T01:47:03.827 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-04-24T01:47:03.827 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-04-24T01:47:04.671 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-04-24T01:47:04.730 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-24T01:47:04.774 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-24T01:47:04.877 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-24T01:47:04.917 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-24T01:47:05.102 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-24T01:47:05.132 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-24T01:47:05.211 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-24T01:47:05.901 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-24T01:47:06.016 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-24T01:47:07.317 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-24T01:47:08.411 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-24T01:47:08.439 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3227.g424d8 12/12 2024-04-24T01:47:10.941 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3227.g424d8 12/12 2024-04-24T01:47:10.941 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3227.g424d8 1/12 2024-04-24T01:47:10.941 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-24T01:47:10.941 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-24T01:47:10.941 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-24T01:47:10.941 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-24T01:47:10.941 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-24T01:47:10.941 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-24T01:47:10.942 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-24T01:47:10.942 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-24T01:47:10.942 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-24T01:47:10.942 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-24T01:47:11.351 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-24T01:47:11.352 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:11.352 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-04-24T01:47:11.352 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3227.g424d8c43.el9.noarch 2024-04-24T01:47:11.352 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-24T01:47:11.352 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-24T01:47:11.352 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-24T01:47:11.352 INFO:teuthology.orchestra.run.smithi057.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-24T01:47:11.352 INFO:teuthology.orchestra.run.smithi057.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-24T01:47:11.352 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-24T01:47:11.352 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-24T01:47:11.352 INFO:teuthology.orchestra.run.smithi057.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-24T01:47:11.352 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-24T01:47:11.353 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-24T01:47:11.353 INFO:teuthology.orchestra.run.smithi057.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-24T01:47:11.353 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:11.353 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-24T01:47:11.721 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-mgr-rook 2024-04-24T01:47:12.256 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:53 ago on Wed 24 Apr 2024 01:45:19 AM UTC. 2024-04-24T01:47:12.381 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-24T01:47:12.383 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:47:12.383 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-04-24T01:47:12.383 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:47:12.383 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-04-24T01:47:12.383 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-rook noarch 2:19.0.0-3227.g424d8c43.el9 ceph-noarch 49 k 2024-04-24T01:47:12.383 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-04-24T01:47:12.383 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-24T01:47:12.383 INFO:teuthology.orchestra.run.smithi057.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-24T01:47:12.383 INFO:teuthology.orchestra.run.smithi057.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-24T01:47:12.384 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-24T01:47:12.384 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-24T01:47:12.384 INFO:teuthology.orchestra.run.smithi057.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-24T01:47:12.384 INFO:teuthology.orchestra.run.smithi057.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-24T01:47:12.384 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-24T01:47:12.384 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-24T01:47:12.384 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-24T01:47:12.384 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-24T01:47:12.384 INFO:teuthology.orchestra.run.smithi057.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-24T01:47:12.384 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:12.384 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-24T01:47:12.384 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:47:12.384 INFO:teuthology.orchestra.run.smithi057.stdout:Install 13 Packages 2024-04-24T01:47:12.384 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:12.385 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 2.2 M 2024-04-24T01:47:12.385 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 26 M 2024-04-24T01:47:12.385 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-04-24T01:47:12.715 INFO:teuthology.orchestra.run.smithi057.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 253 kB/s | 26 kB 00:00 2024-04-24T01:47:12.740 INFO:teuthology.orchestra.run.smithi057.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 152 kB/s | 19 kB 00:00 2024-04-24T01:47:12.882 INFO:teuthology.orchestra.run.smithi057.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-04-24T01:47:12.907 INFO:teuthology.orchestra.run.smithi057.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.3 MB/s | 222 kB 00:00 2024-04-24T01:47:12.933 INFO:teuthology.orchestra.run.smithi057.stdout:(5/13): ceph-mgr-rook-19.0.0-3227.g424d8c43.el9 155 kB/s | 49 kB 00:00 2024-04-24T01:47:12.958 INFO:teuthology.orchestra.run.smithi057.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-04-24T01:47:13.016 INFO:teuthology.orchestra.run.smithi057.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.0 MB/s | 279 kB 00:00 2024-04-24T01:47:13.208 INFO:teuthology.orchestra.run.smithi057.stdout:(8/13): python3-certifi-2021.10.8-2.el9.noarch. 60 kB/s | 15 kB 00:00 2024-04-24T01:47:13.233 INFO:teuthology.orchestra.run.smithi057.stdout:(9/13): python3-cachetools-4.2.4-1.el9.noarch.r 107 kB/s | 32 kB 00:00 2024-04-24T01:47:13.450 INFO:teuthology.orchestra.run.smithi057.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 273 kB/s | 59 kB 00:00 2024-04-24T01:47:13.500 INFO:teuthology.orchestra.run.smithi057.stdout:(11/13): python3-google-auth-2.29.0-1.el9.noarc 425 kB/s | 206 kB 00:00 2024-04-24T01:47:13.642 INFO:teuthology.orchestra.run.smithi057.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 467 kB/s | 90 kB 00:00 2024-04-24T01:47:13.751 INFO:teuthology.orchestra.run.smithi057.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.9 MB/s | 1.0 MB 00:00 2024-04-24T01:47:13.751 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:47:13.752 INFO:teuthology.orchestra.run.smithi057.stdout:Total 1.6 MB/s | 2.2 MB 00:01 2024-04-24T01:47:13.822 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-04-24T01:47:13.839 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-04-24T01:47:13.839 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-04-24T01:47:13.934 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-04-24T01:47:13.934 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-04-24T01:47:14.452 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-04-24T01:47:14.642 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-24T01:47:14.704 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-24T01:47:14.760 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-24T01:47:14.805 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-24T01:47:14.845 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-24T01:47:14.953 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-24T01:47:15.063 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-24T01:47:15.117 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-24T01:47:15.886 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-24T01:47:15.938 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-24T01:47:15.972 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-24T01:47:16.021 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-24T01:47:16.049 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-rook-2:19.0.0-3227.g424d8c43.el9.noarch 13/13 2024-04-24T01:47:16.757 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3227.g424d8c43.el9.noarch 13/13 2024-04-24T01:47:16.757 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3227.g424d8c43.el9.noarch 1/13 2024-04-24T01:47:16.757 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-24T01:47:16.758 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-24T01:47:16.758 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-24T01:47:16.758 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-24T01:47:16.758 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-24T01:47:16.758 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-24T01:47:16.758 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-24T01:47:16.758 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-24T01:47:16.758 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-24T01:47:16.758 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-24T01:47:16.758 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-24T01:47:17.174 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-24T01:47:17.175 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:17.175 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-04-24T01:47:17.175 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-rook-2:19.0.0-3227.g424d8c43.el9.noarch 2024-04-24T01:47:17.175 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-24T01:47:17.175 INFO:teuthology.orchestra.run.smithi057.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-24T01:47:17.175 INFO:teuthology.orchestra.run.smithi057.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-24T01:47:17.175 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-24T01:47:17.175 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-24T01:47:17.175 INFO:teuthology.orchestra.run.smithi057.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-24T01:47:17.175 INFO:teuthology.orchestra.run.smithi057.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-24T01:47:17.175 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-24T01:47:17.175 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-24T01:47:17.175 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-24T01:47:17.175 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-24T01:47:17.175 INFO:teuthology.orchestra.run.smithi057.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-24T01:47:17.176 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:17.176 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-24T01:47:17.428 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-mgr-cephadm 2024-04-24T01:47:17.954 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:58 ago on Wed 24 Apr 2024 01:45:19 AM UTC. 2024-04-24T01:47:18.081 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-24T01:47:18.081 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:47:18.081 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-04-24T01:47:18.081 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:47:18.082 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-04-24T01:47:18.082 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3227.g424d8c43.el9 ceph-noarch 142 k 2024-04-24T01:47:18.082 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-04-24T01:47:18.082 INFO:teuthology.orchestra.run.smithi057.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-24T01:47:18.082 INFO:teuthology.orchestra.run.smithi057.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-24T01:47:18.082 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-24T01:47:18.082 INFO:teuthology.orchestra.run.smithi057.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-24T01:47:18.082 INFO:teuthology.orchestra.run.smithi057.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-24T01:47:18.082 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:18.082 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-24T01:47:18.082 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:47:18.082 INFO:teuthology.orchestra.run.smithi057.stdout:Install 6 Packages 2024-04-24T01:47:18.082 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:18.083 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 7.0 M 2024-04-24T01:47:18.083 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 33 M 2024-04-24T01:47:18.083 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-04-24T01:47:18.780 INFO:teuthology.orchestra.run.smithi057.stdout:(1/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 1.1 MB/s | 248 kB 00:00 2024-04-24T01:47:19.057 INFO:teuthology.orchestra.run.smithi057.stdout:(2/6): ceph-mgr-cephadm-19.0.0-3227.g424d8c43.e 282 kB/s | 142 kB 00:00 2024-04-24T01:47:19.114 INFO:teuthology.orchestra.run.smithi057.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.6 MB/s | 548 kB 00:00 2024-04-24T01:47:19.240 INFO:teuthology.orchestra.run.smithi057.stdout:(4/6): python3-babel-2.9.1-2.el9.noarch.rpm 8.7 MB/s | 6.0 MB 00:00 2024-04-24T01:47:19.265 INFO:teuthology.orchestra.run.smithi057.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 414 kB/s | 51 kB 00:00 2024-04-24T01:47:19.365 INFO:teuthology.orchestra.run.smithi057.stdout:(6/6): python3-natsort-7.1.1-5.el9.noarch.rpm 187 kB/s | 58 kB 00:00 2024-04-24T01:47:19.367 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:47:19.368 INFO:teuthology.orchestra.run.smithi057.stdout:Total 5.4 MB/s | 7.0 MB 00:01 2024-04-24T01:47:19.441 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-04-24T01:47:19.453 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-04-24T01:47:19.453 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-04-24T01:47:19.556 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-04-24T01:47:19.557 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-04-24T01:47:19.601 INFO:teuthology.orchestra.run.smithi084.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 766 kB/s | 16 MB 00:21 2024-04-24T01:47:19.603 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:47:19.603 INFO:teuthology.orchestra.run.smithi084.stdout:Total 1.4 MB/s | 38 MB 00:27 2024-04-24T01:47:19.878 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-04-24T01:47:19.950 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-24T01:47:19.977 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-24T01:47:19.977 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-24T01:47:20.062 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-24T01:47:20.118 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-24T01:47:20.384 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-24T01:47:20.385 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-24T01:47:20.683 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-24T01:47:20.773 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-24T01:47:20.844 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-24T01:47:20.871 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3227.g424d8c43.el9.noarch 6/6 2024-04-24T01:47:21.196 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-24T01:47:21.247 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-04-24T01:47:21.291 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-04-24T01:47:21.393 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-04-24T01:47:21.434 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 4/12 2024-04-24T01:47:21.612 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-04-24T01:47:21.634 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3227.g424d8c43.el9.noarch 6/6 2024-04-24T01:47:21.635 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3227.g424d8c43.el9.noarch 1/6 2024-04-24T01:47:21.635 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-24T01:47:21.635 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-24T01:47:21.635 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-24T01:47:21.635 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-24T01:47:21.649 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-04-24T01:47:21.726 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-04-24T01:47:21.889 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-24T01:47:21.890 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:21.890 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-04-24T01:47:21.890 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-cephadm-2:19.0.0-3227.g424d8c43.el9.noarch 2024-04-24T01:47:21.890 INFO:teuthology.orchestra.run.smithi057.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-24T01:47:21.890 INFO:teuthology.orchestra.run.smithi057.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-24T01:47:21.890 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-24T01:47:21.890 INFO:teuthology.orchestra.run.smithi057.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-24T01:47:21.890 INFO:teuthology.orchestra.run.smithi057.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-24T01:47:21.890 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:21.890 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-24T01:47:22.112 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-fuse 2024-04-24T01:47:22.382 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-04-24T01:47:22.488 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-04-24T01:47:22.642 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:03 ago on Wed 24 Apr 2024 01:45:19 AM UTC. 2024-04-24T01:47:22.767 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-24T01:47:22.767 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:47:22.767 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-04-24T01:47:22.767 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:47:22.768 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-04-24T01:47:22.768 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 871 k 2024-04-24T01:47:22.768 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-04-24T01:47:22.768 INFO:teuthology.orchestra.run.smithi057.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-24T01:47:22.768 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:22.768 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-24T01:47:22.768 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:47:22.768 INFO:teuthology.orchestra.run.smithi057.stdout:Install 2 Packages 2024-04-24T01:47:22.768 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:22.769 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 951 k 2024-04-24T01:47:22.769 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 4.0 M 2024-04-24T01:47:22.769 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-04-24T01:47:23.618 INFO:teuthology.orchestra.run.smithi057.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 114 kB/s | 80 kB 00:00 2024-04-24T01:47:23.740 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-04-24T01:47:23.743 INFO:teuthology.orchestra.run.smithi057.stdout:(2/2): ceph-fuse-19.0.0-3227.g424d8c43.el9.x86_ 1.0 MB/s | 871 kB 00:00 2024-04-24T01:47:23.744 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:47:23.744 INFO:teuthology.orchestra.run.smithi057.stdout:Total 975 kB/s | 951 kB 00:00 2024-04-24T01:47:23.757 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-04-24T01:47:23.784 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-04-24T01:47:23.784 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-04-24T01:47:23.867 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-04-24T01:47:23.867 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-04-24T01:47:24.062 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-04-24T01:47:24.208 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-24T01:47:24.287 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-fuse-2:19.0.0-3227.g424d8c43.el9.x86_64 2/2 2024-04-24T01:47:24.792 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-04-24T01:47:24.832 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3227.g424d8 12/12 2024-04-24T01:47:24.924 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-fuse-2:19.0.0-3227.g424d8c43.el9.x86_64 2/2 2024-04-24T01:47:24.924 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-fuse-2:19.0.0-3227.g424d8c43.el9.x86_64 1/2 2024-04-24T01:47:25.181 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-24T01:47:25.181 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:25.181 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-04-24T01:47:25.181 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse-2:19.0.0-3227.g424d8c43.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-24T01:47:25.181 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:25.181 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-24T01:47:25.440 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-volume 2024-04-24T01:47:25.982 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:06 ago on Wed 24 Apr 2024 01:45:19 AM UTC. 2024-04-24T01:47:26.108 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-24T01:47:26.108 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:47:26.108 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-04-24T01:47:26.109 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:47:26.109 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-04-24T01:47:26.109 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-volume noarch 2:19.0.0-3227.g424d8c43.el9 ceph-noarch 273 k 2024-04-24T01:47:26.109 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-04-24T01:47:26.109 INFO:teuthology.orchestra.run.smithi057.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-24T01:47:26.109 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:26.109 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-24T01:47:26.109 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:47:26.109 INFO:teuthology.orchestra.run.smithi057.stdout:Install 2 Packages 2024-04-24T01:47:26.109 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:26.110 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 350 k 2024-04-24T01:47:26.110 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 1.5 M 2024-04-24T01:47:26.110 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-04-24T01:47:26.290 INFO:teuthology.orchestra.run.smithi057.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 676 kB/s | 77 kB 00:00 2024-04-24T01:47:26.707 INFO:teuthology.orchestra.run.smithi057.stdout:(2/2): ceph-volume-19.0.0-3227.g424d8c43.el9.no 514 kB/s | 273 kB 00:00 2024-04-24T01:47:26.708 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:47:26.708 INFO:teuthology.orchestra.run.smithi057.stdout:Total 584 kB/s | 350 kB 00:00 2024-04-24T01:47:26.720 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-04-24T01:47:26.730 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-04-24T01:47:26.731 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-04-24T01:47:26.759 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-04-24T01:47:26.759 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-04-24T01:47:26.911 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-04-24T01:47:27.110 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-24T01:47:27.143 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-volume-2:19.0.0-3227.g424d8c43.el9.noarch 2/2 2024-04-24T01:47:27.160 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-volume-2:19.0.0-3227.g424d8c43.el9.noarch 2/2 2024-04-24T01:47:27.160 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:47:27.160 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-24T01:47:27.160 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:27.302 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3227.g424d8 12/12 2024-04-24T01:47:27.302 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3227.g424d8 1/12 2024-04-24T01:47:27.302 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-04-24T01:47:27.302 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-04-24T01:47:27.302 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-04-24T01:47:27.302 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-04-24T01:47:27.303 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-04-24T01:47:27.303 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-04-24T01:47:27.303 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-04-24T01:47:27.303 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 9/12 2024-04-24T01:47:27.303 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-04-24T01:47:27.303 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-04-24T01:47:27.721 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-04-24T01:47:27.721 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:27.721 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-24T01:47:27.721 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3227.g424d8c43.el9.noarch 2024-04-24T01:47:27.721 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-24T01:47:27.721 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-24T01:47:27.721 INFO:teuthology.orchestra.run.smithi084.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-24T01:47:27.721 INFO:teuthology.orchestra.run.smithi084.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-24T01:47:27.722 INFO:teuthology.orchestra.run.smithi084.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-24T01:47:27.722 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-24T01:47:27.722 INFO:teuthology.orchestra.run.smithi084.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-24T01:47:27.722 INFO:teuthology.orchestra.run.smithi084.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-24T01:47:27.722 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-24T01:47:27.722 INFO:teuthology.orchestra.run.smithi084.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-24T01:47:27.722 INFO:teuthology.orchestra.run.smithi084.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-24T01:47:27.722 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:27.723 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-24T01:47:27.779 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-volume-2:19.0.0-3227.g424d8c43.el9.noarch 1/2 2024-04-24T01:47:28.048 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-24T01:47:28.048 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:28.048 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-04-24T01:47:28.049 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-volume-2:19.0.0-3227.g424d8c43.el9.noarch 2024-04-24T01:47:28.049 INFO:teuthology.orchestra.run.smithi057.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-24T01:47:28.049 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:28.049 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-24T01:47:28.067 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-mgr-rook 2024-04-24T01:47:28.346 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install librados-devel 2024-04-24T01:47:28.577 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:02:16 ago on Wed 24 Apr 2024 01:45:12 AM UTC. 2024-04-24T01:47:28.698 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-24T01:47:28.699 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:47:28.700 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-04-24T01:47:28.700 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:47:28.700 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-24T01:47:28.700 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook noarch 2:19.0.0-3227.g424d8c43.el9 ceph-noarch 49 k 2024-04-24T01:47:28.700 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-04-24T01:47:28.700 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-24T01:47:28.700 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-24T01:47:28.700 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-24T01:47:28.700 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-24T01:47:28.700 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-24T01:47:28.700 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-24T01:47:28.700 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-24T01:47:28.700 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-24T01:47:28.701 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-24T01:47:28.701 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-24T01:47:28.701 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-24T01:47:28.701 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-24T01:47:28.701 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:28.701 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-24T01:47:28.701 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:47:28.701 INFO:teuthology.orchestra.run.smithi084.stdout:Install 13 Packages 2024-04-24T01:47:28.701 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:28.702 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 2.2 M 2024-04-24T01:47:28.702 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 26 M 2024-04-24T01:47:28.702 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-24T01:47:28.889 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:09 ago on Wed 24 Apr 2024 01:45:19 AM UTC. 2024-04-24T01:47:29.016 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-24T01:47:29.016 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:47:29.017 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repo Size 2024-04-24T01:47:29.017 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:47:29.017 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-04-24T01:47:29.017 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 125 k 2024-04-24T01:47:29.017 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:29.017 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-24T01:47:29.017 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:47:29.017 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2024-04-24T01:47:29.017 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:29.017 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 125 k 2024-04-24T01:47:29.017 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 445 k 2024-04-24T01:47:29.017 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-04-24T01:47:29.034 INFO:teuthology.orchestra.run.smithi084.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 256 kB/s | 26 kB 00:00 2024-04-24T01:47:29.051 INFO:teuthology.orchestra.run.smithi084.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 164 kB/s | 19 kB 00:00 2024-04-24T01:47:29.143 INFO:teuthology.orchestra.run.smithi084.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-04-24T01:47:29.168 INFO:teuthology.orchestra.run.smithi084.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.6 MB/s | 222 kB 00:00 2024-04-24T01:47:29.219 INFO:teuthology.orchestra.run.smithi084.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.6 MB/s | 279 kB 00:00 2024-04-24T01:47:29.244 INFO:teuthology.orchestra.run.smithi084.stdout:(6/13): ceph-mgr-rook-19.0.0-3227.g424d8c43.el9 159 kB/s | 49 kB 00:00 2024-04-24T01:47:29.269 INFO:teuthology.orchestra.run.smithi084.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 534 kB/s | 54 kB 00:00 2024-04-24T01:47:29.397 INFO:teuthology.orchestra.run.smithi057.stdout:librados-devel-19.0.0-3227.g424d8c43.el9.x86_64 329 kB/s | 125 kB 00:00 2024-04-24T01:47:29.398 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:47:29.398 INFO:teuthology.orchestra.run.smithi057.stdout:Total 327 kB/s | 125 kB 00:00 2024-04-24T01:47:29.398 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-04-24T01:47:29.404 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-04-24T01:47:29.404 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-04-24T01:47:29.411 INFO:teuthology.orchestra.run.smithi084.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 167 kB/s | 32 kB 00:00 2024-04-24T01:47:29.436 INFO:teuthology.orchestra.run.smithi084.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 78 kB/s | 15 kB 00:00 2024-04-24T01:47:29.471 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-04-24T01:47:29.472 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-04-24T01:47:29.495 INFO:teuthology.orchestra.run.smithi084.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-04-24T01:47:29.520 INFO:teuthology.orchestra.run.smithi084.stdout:(11/13): python3-google-auth-2.29.0-1.el9.noarc 819 kB/s | 206 kB 00:00 2024-04-24T01:47:29.545 INFO:teuthology.orchestra.run.smithi084.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-04-24T01:47:29.579 INFO:teuthology.orchestra.run.smithi084.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.1 MB/s | 1.0 MB 00:00 2024-04-24T01:47:29.582 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:47:29.582 INFO:teuthology.orchestra.run.smithi084.stdout:Total 2.5 MB/s | 2.2 MB 00:00 2024-04-24T01:47:29.628 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-04-24T01:47:29.641 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-24T01:47:29.656 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-24T01:47:29.657 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-24T01:47:29.730 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librados-devel-2:19.0.0-3227.g424d8c43.el9.x86_64 1/1 2024-04-24T01:47:29.739 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-24T01:47:29.741 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-24T01:47:30.114 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados-devel-2:19.0.0-3227.g424d8c43.el9.x86_64 1/1 2024-04-24T01:47:30.249 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-24T01:47:30.338 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados-devel-2:19.0.0-3227.g424d8c43.el9.x86_64 1/1 2024-04-24T01:47:30.338 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:30.338 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-04-24T01:47:30.338 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:47:30.339 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:30.339 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-24T01:47:30.411 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-04-24T01:47:30.464 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-04-24T01:47:30.519 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-04-24T01:47:30.549 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install libcephfs2 2024-04-24T01:47:30.557 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-04-24T01:47:30.598 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-04-24T01:47:30.692 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-04-24T01:47:30.801 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 7/13 2024-04-24T01:47:30.858 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-04-24T01:47:31.089 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:12 ago on Wed 24 Apr 2024 01:45:19 AM UTC. 2024-04-24T01:47:31.170 INFO:teuthology.orchestra.run.smithi057.stdout:Package libcephfs2-2:19.0.0-3227.g424d8c43.el9.x86_64 is already installed. 2024-04-24T01:47:31.213 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-24T01:47:31.214 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-04-24T01:47:31.214 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-24T01:47:31.291 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install libcephfs-devel 2024-04-24T01:47:31.568 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-04-24T01:47:31.622 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-04-24T01:47:31.656 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-04-24T01:47:31.704 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-04-24T01:47:31.734 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-rook-2:19.0.0-3227.g424d8c43.el9.noarch 13/13 2024-04-24T01:47:31.834 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:12 ago on Wed 24 Apr 2024 01:45:19 AM UTC. 2024-04-24T01:47:31.961 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-24T01:47:31.962 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:47:31.962 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repo Size 2024-04-24T01:47:31.962 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:47:31.962 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-04-24T01:47:31.963 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-devel x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 32 k 2024-04-24T01:47:31.963 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:31.963 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-24T01:47:31.963 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:47:31.963 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2024-04-24T01:47:31.963 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:31.963 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 32 k 2024-04-24T01:47:31.963 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 142 k 2024-04-24T01:47:31.963 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-04-24T01:47:32.327 INFO:teuthology.orchestra.run.smithi057.stdout:libcephfs-devel-19.0.0-3227.g424d8c43.el9.x86_6 87 kB/s | 32 kB 00:00 2024-04-24T01:47:32.328 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:47:32.328 INFO:teuthology.orchestra.run.smithi057.stdout:Total 87 kB/s | 32 kB 00:00 2024-04-24T01:47:32.329 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-04-24T01:47:32.332 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-04-24T01:47:32.332 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-04-24T01:47:32.335 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-04-24T01:47:32.335 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-04-24T01:47:32.421 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-04-24T01:47:32.446 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3227.g424d8c43.el9.noarch 13/13 2024-04-24T01:47:32.446 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3227.g424d8c43.el9.noarch 1/13 2024-04-24T01:47:32.446 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-04-24T01:47:32.446 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-04-24T01:47:32.447 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-04-24T01:47:32.447 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-04-24T01:47:32.447 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-04-24T01:47:32.447 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-04-24T01:47:32.447 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-04-24T01:47:32.447 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-04-24T01:47:32.447 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 10/13 2024-04-24T01:47:32.447 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-04-24T01:47:32.447 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-04-24T01:47:32.526 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephfs-devel-2:19.0.0-3227.g424d8c43.el9.x86_64 1/1 2024-04-24T01:47:32.751 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-04-24T01:47:32.751 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:32.752 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-24T01:47:32.752 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-rook-2:19.0.0-3227.g424d8c43.el9.noarch 2024-04-24T01:47:32.752 INFO:teuthology.orchestra.run.smithi084.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-24T01:47:32.752 INFO:teuthology.orchestra.run.smithi084.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-24T01:47:32.752 INFO:teuthology.orchestra.run.smithi084.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-24T01:47:32.752 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-24T01:47:32.752 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-24T01:47:32.753 INFO:teuthology.orchestra.run.smithi084.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-24T01:47:32.753 INFO:teuthology.orchestra.run.smithi084.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-24T01:47:32.753 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-24T01:47:32.753 INFO:teuthology.orchestra.run.smithi084.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-24T01:47:32.753 INFO:teuthology.orchestra.run.smithi084.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-24T01:47:32.753 INFO:teuthology.orchestra.run.smithi084.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-24T01:47:32.753 INFO:teuthology.orchestra.run.smithi084.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-24T01:47:32.754 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:32.754 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-24T01:47:32.871 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-3227.g424d8c43.el9.x86_64 1/1 2024-04-24T01:47:32.993 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-mgr-cephadm 2024-04-24T01:47:33.088 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs-devel-2:19.0.0-3227.g424d8c43.el9.x86_64 1/1 2024-04-24T01:47:33.088 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:33.088 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-04-24T01:47:33.089 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-devel-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:47:33.089 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:33.089 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-24T01:47:33.253 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install librados2 2024-04-24T01:47:33.497 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:02:21 ago on Wed 24 Apr 2024 01:45:12 AM UTC. 2024-04-24T01:47:33.616 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-24T01:47:33.617 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:47:33.617 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-04-24T01:47:33.617 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:47:33.617 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-24T01:47:33.617 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3227.g424d8c43.el9 ceph-noarch 142 k 2024-04-24T01:47:33.617 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-04-24T01:47:33.617 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-24T01:47:33.617 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-24T01:47:33.618 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-24T01:47:33.618 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-24T01:47:33.618 INFO:teuthology.orchestra.run.smithi084.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-24T01:47:33.618 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:33.618 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-24T01:47:33.618 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:47:33.618 INFO:teuthology.orchestra.run.smithi084.stdout:Install 6 Packages 2024-04-24T01:47:33.618 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:33.619 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 7.0 M 2024-04-24T01:47:33.619 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 33 M 2024-04-24T01:47:33.619 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-24T01:47:33.785 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:14 ago on Wed 24 Apr 2024 01:45:19 AM UTC. 2024-04-24T01:47:33.872 INFO:teuthology.orchestra.run.smithi057.stdout:Package librados2-2:19.0.0-3227.g424d8c43.el9.x86_64 is already installed. 2024-04-24T01:47:33.915 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-24T01:47:33.917 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-04-24T01:47:33.917 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-24T01:47:33.991 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install librbd1 2024-04-24T01:47:34.148 INFO:teuthology.orchestra.run.smithi084.stdout:(1/6): ceph-mgr-cephadm-19.0.0-3227.g424d8c43.e 633 kB/s | 142 kB 00:00 2024-04-24T01:47:34.173 INFO:teuthology.orchestra.run.smithi084.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 993 kB/s | 248 kB 00:00 2024-04-24T01:47:34.515 INFO:teuthology.orchestra.run.smithi084.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 169 kB/s | 58 kB 00:00 2024-04-24T01:47:34.530 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:15 ago on Wed 24 Apr 2024 01:45:19 AM UTC. 2024-04-24T01:47:34.599 INFO:teuthology.orchestra.run.smithi084.stdout:(4/6): python3-babel-2.9.1-2.el9.noarch.rpm 8.8 MB/s | 6.0 MB 00:00 2024-04-24T01:47:34.612 INFO:teuthology.orchestra.run.smithi057.stdout:Package librbd1-2:19.0.0-3227.g424d8c43.el9.x86_64 is already installed. 2024-04-24T01:47:34.657 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-24T01:47:34.658 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-04-24T01:47:34.658 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-24T01:47:34.725 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install python3-rados 2024-04-24T01:47:34.790 INFO:teuthology.orchestra.run.smithi084.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 853 kB/s | 548 kB 00:00 2024-04-24T01:47:34.904 INFO:teuthology.orchestra.run.smithi084.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 131 kB/s | 51 kB 00:00 2024-04-24T01:47:34.905 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:47:34.906 INFO:teuthology.orchestra.run.smithi084.stdout:Total 5.4 MB/s | 7.0 MB 00:01 2024-04-24T01:47:34.976 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-24T01:47:34.988 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-24T01:47:34.988 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-24T01:47:35.085 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-24T01:47:35.085 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-24T01:47:35.259 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:16 ago on Wed 24 Apr 2024 01:45:19 AM UTC. 2024-04-24T01:47:35.340 INFO:teuthology.orchestra.run.smithi057.stdout:Package python3-rados-2:19.0.0-3227.g424d8c43.el9.x86_64 is already installed. 2024-04-24T01:47:35.385 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-24T01:47:35.386 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-04-24T01:47:35.386 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-24T01:47:35.388 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-24T01:47:35.445 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install python3-rgw 2024-04-24T01:47:35.568 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-04-24T01:47:35.617 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-04-24T01:47:35.985 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:16 ago on Wed 24 Apr 2024 01:45:19 AM UTC. 2024-04-24T01:47:36.067 INFO:teuthology.orchestra.run.smithi057.stdout:Package python3-rgw-2:19.0.0-3227.g424d8c43.el9.x86_64 is already installed. 2024-04-24T01:47:36.111 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-24T01:47:36.112 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-04-24T01:47:36.112 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-24T01:47:36.132 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-04-24T01:47:36.170 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install python3-cephfs 2024-04-24T01:47:36.220 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-04-24T01:47:36.291 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-04-24T01:47:36.321 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3227.g424d8c43.el9.noarch 6/6 2024-04-24T01:47:36.711 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:17 ago on Wed 24 Apr 2024 01:45:19 AM UTC. 2024-04-24T01:47:36.794 INFO:teuthology.orchestra.run.smithi057.stdout:Package python3-cephfs-2:19.0.0-3227.g424d8c43.el9.x86_64 is already installed. 2024-04-24T01:47:36.837 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-24T01:47:36.839 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-04-24T01:47:36.839 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-24T01:47:36.896 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install python3-rbd 2024-04-24T01:47:37.105 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3227.g424d8c43.el9.noarch 6/6 2024-04-24T01:47:37.106 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3227.g424d8c43.el9.noarch 1/6 2024-04-24T01:47:37.106 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-04-24T01:47:37.106 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-04-24T01:47:37.106 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-04-24T01:47:37.106 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-04-24T01:47:37.351 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-04-24T01:47:37.351 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:37.351 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-24T01:47:37.351 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-mgr-cephadm-2:19.0.0-3227.g424d8c43.el9.noarch 2024-04-24T01:47:37.351 INFO:teuthology.orchestra.run.smithi084.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-24T01:47:37.351 INFO:teuthology.orchestra.run.smithi084.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-24T01:47:37.351 INFO:teuthology.orchestra.run.smithi084.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-24T01:47:37.352 INFO:teuthology.orchestra.run.smithi084.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-24T01:47:37.352 INFO:teuthology.orchestra.run.smithi084.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-24T01:47:37.352 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:37.352 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-24T01:47:37.430 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:18 ago on Wed 24 Apr 2024 01:45:19 AM UTC. 2024-04-24T01:47:37.511 INFO:teuthology.orchestra.run.smithi057.stdout:Package python3-rbd-2:19.0.0-3227.g424d8c43.el9.x86_64 is already installed. 2024-04-24T01:47:37.554 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-24T01:47:37.555 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2024-04-24T01:47:37.555 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-24T01:47:37.588 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-fuse 2024-04-24T01:47:37.613 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install rbd-fuse 2024-04-24T01:47:38.098 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:02:26 ago on Wed 24 Apr 2024 01:45:12 AM UTC. 2024-04-24T01:47:38.149 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:19 ago on Wed 24 Apr 2024 01:45:19 AM UTC. 2024-04-24T01:47:38.218 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-24T01:47:38.219 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:47:38.219 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-04-24T01:47:38.219 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:47:38.219 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-24T01:47:38.220 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 871 k 2024-04-24T01:47:38.220 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-04-24T01:47:38.220 INFO:teuthology.orchestra.run.smithi084.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-24T01:47:38.220 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:38.220 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-24T01:47:38.220 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:47:38.220 INFO:teuthology.orchestra.run.smithi084.stdout:Install 2 Packages 2024-04-24T01:47:38.220 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:38.220 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 951 k 2024-04-24T01:47:38.220 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 4.0 M 2024-04-24T01:47:38.220 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-24T01:47:38.275 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-24T01:47:38.276 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:47:38.276 INFO:teuthology.orchestra.run.smithi057.stdout: Package Architecture Version Repository Size 2024-04-24T01:47:38.276 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:47:38.276 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-04-24T01:47:38.276 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 90 k 2024-04-24T01:47:38.276 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:38.276 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-24T01:47:38.276 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:47:38.276 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2024-04-24T01:47:38.277 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:38.277 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 90 k 2024-04-24T01:47:38.277 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 313 k 2024-04-24T01:47:38.277 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-04-24T01:47:38.489 INFO:teuthology.orchestra.run.smithi057.stdout:rbd-fuse-19.0.0-3227.g424d8c43.el9.x86_64.rpm 424 kB/s | 90 kB 00:00 2024-04-24T01:47:38.489 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:47:38.490 INFO:teuthology.orchestra.run.smithi057.stdout:Total 421 kB/s | 90 kB 00:00 2024-04-24T01:47:38.490 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-04-24T01:47:38.500 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-04-24T01:47:38.500 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-04-24T01:47:38.566 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-04-24T01:47:38.567 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-04-24T01:47:38.684 INFO:teuthology.orchestra.run.smithi084.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 264 kB/s | 80 kB 00:00 2024-04-24T01:47:38.715 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-04-24T01:47:38.821 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-fuse-2:19.0.0-3227.g424d8c43.el9.x86_64 1/1 2024-04-24T01:47:39.059 INFO:teuthology.orchestra.run.smithi084.stdout:(2/2): ceph-fuse-19.0.0-3227.g424d8c43.el9.x86_ 1.3 MB/s | 871 kB 00:00 2024-04-24T01:47:39.059 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:47:39.060 INFO:teuthology.orchestra.run.smithi084.stdout:Total 1.1 MB/s | 951 kB 00:00 2024-04-24T01:47:39.071 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-24T01:47:39.096 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-24T01:47:39.096 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-24T01:47:39.174 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-24T01:47:39.174 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-24T01:47:39.176 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: rbd-fuse-2:19.0.0-3227.g424d8c43.el9.x86_64 1/1 2024-04-24T01:47:39.357 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-24T01:47:39.431 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-fuse-2:19.0.0-3227.g424d8c43.el9.x86_64 1/1 2024-04-24T01:47:39.431 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:39.431 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-04-24T01:47:39.431 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:47:39.431 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:39.431 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-24T01:47:39.494 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-04-24T01:47:39.573 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-fuse-2:19.0.0-3227.g424d8c43.el9.x86_64 2/2 2024-04-24T01:47:39.679 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install rbd-mirror 2024-04-24T01:47:40.194 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-fuse-2:19.0.0-3227.g424d8c43.el9.x86_64 2/2 2024-04-24T01:47:40.194 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-fuse-2:19.0.0-3227.g424d8c43.el9.x86_64 1/2 2024-04-24T01:47:40.225 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:21 ago on Wed 24 Apr 2024 01:45:19 AM UTC. 2024-04-24T01:47:40.352 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-24T01:47:40.353 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:47:40.353 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repo Size 2024-04-24T01:47:40.353 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:47:40.353 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-04-24T01:47:40.353 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 3.4 M 2024-04-24T01:47:40.353 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:40.353 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-24T01:47:40.353 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:47:40.353 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2024-04-24T01:47:40.354 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:40.354 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 3.4 M 2024-04-24T01:47:40.354 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 29 M 2024-04-24T01:47:40.354 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-04-24T01:47:40.448 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-04-24T01:47:40.448 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:40.448 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-24T01:47:40.448 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-fuse-2:19.0.0-3227.g424d8c43.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-04-24T01:47:40.449 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:40.449 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-24T01:47:40.729 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install ceph-volume 2024-04-24T01:47:41.061 INFO:teuthology.orchestra.run.smithi057.stdout:rbd-mirror-19.0.0-3227.g424d8c43.el9.x86_64.rpm 4.8 MB/s | 3.4 MB 00:00 2024-04-24T01:47:41.061 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:47:41.062 INFO:teuthology.orchestra.run.smithi057.stdout:Total 4.8 MB/s | 3.4 MB 00:00 2024-04-24T01:47:41.062 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-04-24T01:47:41.075 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-04-24T01:47:41.075 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-04-24T01:47:41.162 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-04-24T01:47:41.162 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-04-24T01:47:41.246 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:02:29 ago on Wed 24 Apr 2024 01:45:12 AM UTC. 2024-04-24T01:47:41.368 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-24T01:47:41.369 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:47:41.369 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repository Size 2024-04-24T01:47:41.369 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:47:41.369 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-24T01:47:41.369 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-volume noarch 2:19.0.0-3227.g424d8c43.el9 ceph-noarch 273 k 2024-04-24T01:47:41.369 INFO:teuthology.orchestra.run.smithi084.stdout:Installing dependencies: 2024-04-24T01:47:41.369 INFO:teuthology.orchestra.run.smithi084.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-24T01:47:41.369 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:41.369 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-24T01:47:41.370 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:47:41.370 INFO:teuthology.orchestra.run.smithi084.stdout:Install 2 Packages 2024-04-24T01:47:41.370 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:41.370 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 350 k 2024-04-24T01:47:41.370 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 1.5 M 2024-04-24T01:47:41.370 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-24T01:47:41.597 INFO:teuthology.orchestra.run.smithi084.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 515 kB/s | 77 kB 00:00 2024-04-24T01:47:41.758 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-04-24T01:47:41.806 INFO:teuthology.orchestra.run.smithi084.stdout:(2/2): ceph-volume-19.0.0-3227.g424d8c43.el9.no 762 kB/s | 273 kB 00:00 2024-04-24T01:47:41.807 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:47:41.807 INFO:teuthology.orchestra.run.smithi084.stdout:Total 802 kB/s | 350 kB 00:00 2024-04-24T01:47:41.818 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-24T01:47:41.827 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-24T01:47:41.827 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-24T01:47:41.828 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-mirror-2:19.0.0-3227.g424d8c43.el9.x86_64 1/1 2024-04-24T01:47:41.854 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-24T01:47:41.854 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-24T01:47:41.854 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3227.g424d8c43.el9.x86_64 1/1 2024-04-24T01:47:41.855 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:47:41.855 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-24T01:47:41.855 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-24T01:47:41.855 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-24T01:47:41.855 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:41.999 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-24T01:47:42.187 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-04-24T01:47:42.216 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : ceph-volume-2:19.0.0-3227.g424d8c43.el9.noarch 2/2 2024-04-24T01:47:42.231 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: ceph-volume-2:19.0.0-3227.g424d8c43.el9.noarch 2/2 2024-04-24T01:47:42.231 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:47:42.231 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-24T01:47:42.232 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:42.956 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : ceph-volume-2:19.0.0-3227.g424d8c43.el9.noarch 1/2 2024-04-24T01:47:43.029 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-mirror-2:19.0.0-3227.g424d8c43.el9.x86_64 1/1 2024-04-24T01:47:43.029 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:43.030 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-04-24T01:47:43.030 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:47:43.030 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:43.030 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-24T01:47:43.238 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-04-24T01:47:43.238 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:43.238 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-24T01:47:43.238 INFO:teuthology.orchestra.run.smithi084.stdout: ceph-volume-2:19.0.0-3227.g424d8c43.el9.noarch 2024-04-24T01:47:43.238 INFO:teuthology.orchestra.run.smithi084.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-24T01:47:43.238 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:43.238 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-24T01:47:43.282 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install rbd-nbd 2024-04-24T01:47:43.512 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install librados-devel 2024-04-24T01:47:43.815 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:24 ago on Wed 24 Apr 2024 01:45:19 AM UTC. 2024-04-24T01:47:43.945 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-04-24T01:47:43.946 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:47:43.946 INFO:teuthology.orchestra.run.smithi057.stdout: Package Architecture Version Repository Size 2024-04-24T01:47:43.946 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:47:43.946 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-04-24T01:47:43.946 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 175 k 2024-04-24T01:47:43.947 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:43.947 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-04-24T01:47:43.947 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-04-24T01:47:43.947 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2024-04-24T01:47:43.947 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:43.947 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 175 k 2024-04-24T01:47:43.947 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 673 k 2024-04-24T01:47:43.947 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-04-24T01:47:44.038 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:02:32 ago on Wed 24 Apr 2024 01:45:12 AM UTC. 2024-04-24T01:47:44.159 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-24T01:47:44.160 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:47:44.160 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repo Size 2024-04-24T01:47:44.160 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:47:44.160 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-24T01:47:44.160 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 125 k 2024-04-24T01:47:44.160 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:44.160 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-24T01:47:44.161 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:47:44.161 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2024-04-24T01:47:44.161 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:44.161 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 125 k 2024-04-24T01:47:44.161 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 445 k 2024-04-24T01:47:44.161 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-24T01:47:44.541 INFO:teuthology.orchestra.run.smithi057.stdout:rbd-nbd-19.0.0-3227.g424d8c43.el9.x86_64.rpm 295 kB/s | 175 kB 00:00 2024-04-24T01:47:44.542 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:47:44.542 INFO:teuthology.orchestra.run.smithi057.stdout:Total 295 kB/s | 175 kB 00:00 2024-04-24T01:47:44.542 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-04-24T01:47:44.553 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-04-24T01:47:44.553 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-04-24T01:47:44.586 INFO:teuthology.orchestra.run.smithi084.stdout:librados-devel-19.0.0-3227.g424d8c43.el9.x86_64 294 kB/s | 125 kB 00:00 2024-04-24T01:47:44.586 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:47:44.587 INFO:teuthology.orchestra.run.smithi084.stdout:Total 293 kB/s | 125 kB 00:00 2024-04-24T01:47:44.587 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-24T01:47:44.592 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-24T01:47:44.593 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-24T01:47:44.622 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-04-24T01:47:44.623 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-04-24T01:47:44.657 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-24T01:47:44.657 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-24T01:47:44.792 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-04-24T01:47:44.815 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-24T01:47:44.899 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-nbd-2:19.0.0-3227.g424d8c43.el9.x86_64 1/1 2024-04-24T01:47:44.907 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : librados-devel-2:19.0.0-3227.g424d8c43.el9.x86_64 1/1 2024-04-24T01:47:45.303 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: librados-devel-2:19.0.0-3227.g424d8c43.el9.x86_64 1/1 2024-04-24T01:47:45.307 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: rbd-nbd-2:19.0.0-3227.g424d8c43.el9.x86_64 1/1 2024-04-24T01:47:45.536 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : librados-devel-2:19.0.0-3227.g424d8c43.el9.x86_64 1/1 2024-04-24T01:47:45.536 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:45.536 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-24T01:47:45.536 INFO:teuthology.orchestra.run.smithi084.stdout: librados-devel-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:47:45.536 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:45.536 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-24T01:47:45.577 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-nbd-2:19.0.0-3227.g424d8c43.el9.x86_64 1/1 2024-04-24T01:47:45.577 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:45.577 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-04-24T01:47:45.578 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:47:45.578 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:47:45.578 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-04-24T01:47:45.780 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install libcephfs2 2024-04-24T01:47:45.829 DEBUG:teuthology.parallel:result is None 2024-04-24T01:47:46.299 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:02:34 ago on Wed 24 Apr 2024 01:45:12 AM UTC. 2024-04-24T01:47:46.378 INFO:teuthology.orchestra.run.smithi084.stdout:Package libcephfs2-2:19.0.0-3227.g424d8c43.el9.x86_64 is already installed. 2024-04-24T01:47:46.420 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-24T01:47:46.421 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-04-24T01:47:46.421 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-24T01:47:46.497 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install libcephfs-devel 2024-04-24T01:47:47.022 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:02:35 ago on Wed 24 Apr 2024 01:45:12 AM UTC. 2024-04-24T01:47:47.144 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-24T01:47:47.145 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:47:47.145 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repo Size 2024-04-24T01:47:47.145 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:47:47.145 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-24T01:47:47.145 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 32 k 2024-04-24T01:47:47.146 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:47.146 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-24T01:47:47.146 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:47:47.146 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2024-04-24T01:47:47.146 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:47.146 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 32 k 2024-04-24T01:47:47.146 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 142 k 2024-04-24T01:47:47.146 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-24T01:47:47.440 INFO:teuthology.orchestra.run.smithi084.stdout:libcephfs-devel-19.0.0-3227.g424d8c43.el9.x86_6 108 kB/s | 32 kB 00:00 2024-04-24T01:47:47.441 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:47:47.441 INFO:teuthology.orchestra.run.smithi084.stdout:Total 107 kB/s | 32 kB 00:00 2024-04-24T01:47:47.441 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-24T01:47:47.444 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-24T01:47:47.444 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-24T01:47:47.446 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-24T01:47:47.447 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-24T01:47:47.538 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-24T01:47:47.653 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : libcephfs-devel-2:19.0.0-3227.g424d8c43.el9.x86_64 1/1 2024-04-24T01:47:48.007 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-3227.g424d8c43.el9.x86_64 1/1 2024-04-24T01:47:48.226 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : libcephfs-devel-2:19.0.0-3227.g424d8c43.el9.x86_64 1/1 2024-04-24T01:47:48.226 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:48.226 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-24T01:47:48.226 INFO:teuthology.orchestra.run.smithi084.stdout: libcephfs-devel-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:47:48.226 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:48.226 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-24T01:47:48.408 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install librados2 2024-04-24T01:47:48.923 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:02:36 ago on Wed 24 Apr 2024 01:45:12 AM UTC. 2024-04-24T01:47:49.001 INFO:teuthology.orchestra.run.smithi084.stdout:Package librados2-2:19.0.0-3227.g424d8c43.el9.x86_64 is already installed. 2024-04-24T01:47:49.042 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-24T01:47:49.043 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-04-24T01:47:49.043 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-24T01:47:49.114 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install librbd1 2024-04-24T01:47:49.625 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:02:37 ago on Wed 24 Apr 2024 01:45:12 AM UTC. 2024-04-24T01:47:49.704 INFO:teuthology.orchestra.run.smithi084.stdout:Package librbd1-2:19.0.0-3227.g424d8c43.el9.x86_64 is already installed. 2024-04-24T01:47:49.746 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-24T01:47:49.747 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-04-24T01:47:49.747 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-24T01:47:49.821 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install python3-rados 2024-04-24T01:47:50.330 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:02:38 ago on Wed 24 Apr 2024 01:45:12 AM UTC. 2024-04-24T01:47:50.408 INFO:teuthology.orchestra.run.smithi084.stdout:Package python3-rados-2:19.0.0-3227.g424d8c43.el9.x86_64 is already installed. 2024-04-24T01:47:50.448 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-24T01:47:50.449 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-04-24T01:47:50.449 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-24T01:47:50.526 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install python3-rgw 2024-04-24T01:47:51.039 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:02:39 ago on Wed 24 Apr 2024 01:45:12 AM UTC. 2024-04-24T01:47:51.117 INFO:teuthology.orchestra.run.smithi084.stdout:Package python3-rgw-2:19.0.0-3227.g424d8c43.el9.x86_64 is already installed. 2024-04-24T01:47:51.157 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-24T01:47:51.158 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-04-24T01:47:51.158 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-24T01:47:51.233 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install python3-cephfs 2024-04-24T01:47:51.750 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:02:39 ago on Wed 24 Apr 2024 01:45:12 AM UTC. 2024-04-24T01:47:51.827 INFO:teuthology.orchestra.run.smithi084.stdout:Package python3-cephfs-2:19.0.0-3227.g424d8c43.el9.x86_64 is already installed. 2024-04-24T01:47:51.868 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-24T01:47:51.869 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-04-24T01:47:51.869 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-24T01:47:51.942 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install python3-rbd 2024-04-24T01:47:52.447 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:02:40 ago on Wed 24 Apr 2024 01:45:12 AM UTC. 2024-04-24T01:47:52.525 INFO:teuthology.orchestra.run.smithi084.stdout:Package python3-rbd-2:19.0.0-3227.g424d8c43.el9.x86_64 is already installed. 2024-04-24T01:47:52.566 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-24T01:47:52.567 INFO:teuthology.orchestra.run.smithi084.stdout:Nothing to do. 2024-04-24T01:47:52.568 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-24T01:47:52.633 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install rbd-fuse 2024-04-24T01:47:53.140 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:02:41 ago on Wed 24 Apr 2024 01:45:12 AM UTC. 2024-04-24T01:47:53.263 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-24T01:47:53.263 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:47:53.264 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2024-04-24T01:47:53.264 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:47:53.264 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-24T01:47:53.264 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 90 k 2024-04-24T01:47:53.264 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:53.264 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-24T01:47:53.264 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:47:53.264 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2024-04-24T01:47:53.264 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:53.264 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 90 k 2024-04-24T01:47:53.265 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 313 k 2024-04-24T01:47:53.265 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-24T01:47:53.476 INFO:teuthology.orchestra.run.smithi084.stdout:rbd-fuse-19.0.0-3227.g424d8c43.el9.x86_64.rpm 425 kB/s | 90 kB 00:00 2024-04-24T01:47:53.477 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:47:53.477 INFO:teuthology.orchestra.run.smithi084.stdout:Total 422 kB/s | 90 kB 00:00 2024-04-24T01:47:53.477 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-24T01:47:53.485 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-24T01:47:53.486 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-24T01:47:53.549 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-24T01:47:53.549 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-24T01:47:53.693 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-24T01:47:53.779 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-fuse-2:19.0.0-3227.g424d8c43.el9.x86_64 1/1 2024-04-24T01:47:54.118 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-fuse-2:19.0.0-3227.g424d8c43.el9.x86_64 1/1 2024-04-24T01:47:54.356 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-fuse-2:19.0.0-3227.g424d8c43.el9.x86_64 1/1 2024-04-24T01:47:54.356 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:54.356 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-24T01:47:54.356 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-fuse-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:47:54.356 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:54.356 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-24T01:47:54.589 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install rbd-mirror 2024-04-24T01:47:55.106 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:02:43 ago on Wed 24 Apr 2024 01:45:12 AM UTC. 2024-04-24T01:47:55.227 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-24T01:47:55.227 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:47:55.228 INFO:teuthology.orchestra.run.smithi084.stdout: Package Arch Version Repo Size 2024-04-24T01:47:55.228 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:47:55.228 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-24T01:47:55.228 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 3.4 M 2024-04-24T01:47:55.228 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:55.228 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-24T01:47:55.228 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:47:55.228 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2024-04-24T01:47:55.228 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:55.228 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 3.4 M 2024-04-24T01:47:55.228 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 29 M 2024-04-24T01:47:55.228 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-24T01:47:56.171 INFO:teuthology.orchestra.run.smithi084.stdout:rbd-mirror-19.0.0-3227.g424d8c43.el9.x86_64.rpm 3.6 MB/s | 3.4 MB 00:00 2024-04-24T01:47:56.172 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:47:56.172 INFO:teuthology.orchestra.run.smithi084.stdout:Total 3.6 MB/s | 3.4 MB 00:00 2024-04-24T01:47:56.172 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-24T01:47:56.184 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-24T01:47:56.184 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-24T01:47:56.267 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-24T01:47:56.267 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-24T01:47:56.854 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-24T01:47:56.922 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-mirror-2:19.0.0-3227.g424d8c43.el9.x86_64 1/1 2024-04-24T01:47:56.947 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3227.g424d8c43.el9.x86_64 1/1 2024-04-24T01:47:56.947 INFO:teuthology.orchestra.run.smithi084.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-24T01:47:56.947 INFO:teuthology.orchestra.run.smithi084.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-24T01:47:56.947 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-24T01:47:56.947 INFO:teuthology.orchestra.run.smithi084.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-24T01:47:56.947 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:58.115 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-mirror-2:19.0.0-3227.g424d8c43.el9.x86_64 1/1 2024-04-24T01:47:58.115 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:58.116 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-24T01:47:58.116 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-mirror-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:47:58.116 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:58.116 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-24T01:47:58.349 DEBUG:teuthology.orchestra.run.smithi084:> sudo yum -y install rbd-nbd 2024-04-24T01:47:58.872 INFO:teuthology.orchestra.run.smithi084.stdout:Last metadata expiration check: 0:02:46 ago on Wed 24 Apr 2024 01:45:12 AM UTC. 2024-04-24T01:47:58.993 INFO:teuthology.orchestra.run.smithi084.stdout:Dependencies resolved. 2024-04-24T01:47:58.994 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:47:58.994 INFO:teuthology.orchestra.run.smithi084.stdout: Package Architecture Version Repository Size 2024-04-24T01:47:58.994 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:47:58.994 INFO:teuthology.orchestra.run.smithi084.stdout:Installing: 2024-04-24T01:47:58.995 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd x86_64 2:19.0.0-3227.g424d8c43.el9 ceph 175 k 2024-04-24T01:47:58.995 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:58.995 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction Summary 2024-04-24T01:47:58.995 INFO:teuthology.orchestra.run.smithi084.stdout:================================================================================ 2024-04-24T01:47:58.995 INFO:teuthology.orchestra.run.smithi084.stdout:Install 1 Package 2024-04-24T01:47:58.995 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:47:58.995 INFO:teuthology.orchestra.run.smithi084.stdout:Total download size: 175 k 2024-04-24T01:47:58.995 INFO:teuthology.orchestra.run.smithi084.stdout:Installed size: 673 k 2024-04-24T01:47:58.995 INFO:teuthology.orchestra.run.smithi084.stdout:Downloading Packages: 2024-04-24T01:47:59.232 INFO:teuthology.orchestra.run.smithi084.stdout:rbd-nbd-19.0.0-3227.g424d8c43.el9.x86_64.rpm 741 kB/s | 175 kB 00:00 2024-04-24T01:47:59.233 INFO:teuthology.orchestra.run.smithi084.stdout:-------------------------------------------------------------------------------- 2024-04-24T01:47:59.233 INFO:teuthology.orchestra.run.smithi084.stdout:Total 735 kB/s | 175 kB 00:00 2024-04-24T01:47:59.233 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction check 2024-04-24T01:47:59.243 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction check succeeded. 2024-04-24T01:47:59.243 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction test 2024-04-24T01:47:59.306 INFO:teuthology.orchestra.run.smithi084.stdout:Transaction test succeeded. 2024-04-24T01:47:59.307 INFO:teuthology.orchestra.run.smithi084.stdout:Running transaction 2024-04-24T01:47:59.462 INFO:teuthology.orchestra.run.smithi084.stdout: Preparing : 1/1 2024-04-24T01:47:59.587 INFO:teuthology.orchestra.run.smithi084.stdout: Installing : rbd-nbd-2:19.0.0-3227.g424d8c43.el9.x86_64 1/1 2024-04-24T01:47:59.963 INFO:teuthology.orchestra.run.smithi084.stdout: Running scriptlet: rbd-nbd-2:19.0.0-3227.g424d8c43.el9.x86_64 1/1 2024-04-24T01:48:00.207 INFO:teuthology.orchestra.run.smithi084.stdout: Verifying : rbd-nbd-2:19.0.0-3227.g424d8c43.el9.x86_64 1/1 2024-04-24T01:48:00.207 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:00.207 INFO:teuthology.orchestra.run.smithi084.stdout:Installed: 2024-04-24T01:48:00.207 INFO:teuthology.orchestra.run.smithi084.stdout: rbd-nbd-2:19.0.0-3227.g424d8c43.el9.x86_64 2024-04-24T01:48:00.207 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:00.207 INFO:teuthology.orchestra.run.smithi084.stdout:Complete! 2024-04-24T01:48:00.477 DEBUG:teuthology.parallel:result is None 2024-04-24T01:48:00.477 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=424d8c4389b684b0a4d72510e1b4d398d8e6c8f4 2024-04-24T01:48:00.620 DEBUG:teuthology.orchestra.run.smithi057:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-24T01:48:00.646 INFO:teuthology.orchestra.run.smithi057.stdout:19.0.0-3227.g424d8c43.el9 2024-04-24T01:48:00.647 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3227.g424d8c43.el9 2024-04-24T01:48:00.647 INFO:teuthology.task.install:The correct ceph version 19.0.0-3227.g424d8c43 is installed. 2024-04-24T01:48:00.649 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=crimson&distros=centos%2F9%2Fx86_64&sha1=424d8c4389b684b0a4d72510e1b4d398d8e6c8f4 2024-04-24T01:48:00.788 DEBUG:teuthology.orchestra.run.smithi084:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-24T01:48:00.808 INFO:teuthology.orchestra.run.smithi084.stdout:19.0.0-3227.g424d8c43.el9 2024-04-24T01:48:00.809 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3227.g424d8c43.el9 2024-04-24T01:48:00.809 INFO:teuthology.task.install:The correct ceph version 19.0.0-3227.g424d8c43 is installed. 2024-04-24T01:48:00.811 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-24T01:48:00.811 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T01:48:00.812 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-24T01:48:00.842 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-24T01:48:00.842 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-24T01:48:00.873 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-24T01:48:00.873 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T01:48:00.873 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/daemon-helper 2024-04-24T01:48:00.911 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-24T01:48:00.979 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-24T01:48:00.979 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/daemon-helper 2024-04-24T01:48:01.002 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-24T01:48:01.065 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-24T01:48:01.065 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T01:48:01.065 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-24T01:48:01.094 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-24T01:48:01.162 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-24T01:48:01.162 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-24T01:48:01.185 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-24T01:48:01.287 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-24T01:48:01.287 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T01:48:01.287 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/stdin-killer 2024-04-24T01:48:01.316 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-24T01:48:01.385 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-24T01:48:01.385 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/usr/bin/stdin-killer 2024-04-24T01:48:01.411 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-24T01:48:01.475 INFO:teuthology.run_tasks:Running task ceph... 2024-04-24T01:48:01.563 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-24T01:48:01.564 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 777 /var/log/ceph 2024-04-24T01:48:01.566 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 777 /var/log/ceph 2024-04-24T01:48:01.593 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-24T01:48:01.593 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-24T01:48:01.636 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-24T01:48:01.662 INFO:tasks.ceph:Creating extra log directories... 2024-04-24T01:48:01.662 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-24T01:48:01.704 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-24T01:48:01.739 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-24T01:48:01.740 INFO:tasks.ceph:config {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-24T01:48:01.740 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yingxin-2024-04-24_01:32:34-crimson-rados-ci-yingxin-crimson-load-obc-new-1-distro-default-smithi/7671128', 'branch': 'ci-yingxin-crimson-load-obc-new-1', 'description': 'crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests}', 'email': 'yingxin.cheng@intel.com', 'first_in_suite': False, 'job_id': '7671128', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yingxin-2024-04-24_01:32:34-crimson-rados-ci-yingxin-crimson-load-obc-new-1-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'ci-yingxin-crimson-load-obc-new-1'}, 'ceph': {'conf': {'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '424d8c4389b684b0a4d72510e1b4d398d8e6c8f4'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'crimson', 'sha1': '424d8c4389b684b0a4d72510e1b4d398d8e6c8f4'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'workunit': {'branch': 'ci-yingxin-crimson-load-obc-new-1', 'env': {'CRIMSON_COMPAT': '1'}, 'sha1': '424d8c4389b684b0a4d72510e1b4d398d8e6c8f4'}}, 'owner': 'scheduled_yingxin@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0', 'osd.1', 'client.0', 'node-exporter.a'], ['mgr.x', 'osd.2', 'osd.3', 'client.1', 'prometheus.a', 'node-exporter.b']], 'sha1': '424d8c4389b684b0a4d72510e1b4d398d8e6c8f4', 'sleep_before_teardown': 0, 'suite': 'crimson-rados', 'suite_branch': 'ci-yingxin-crimson-load-obc-new-1', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_424d8c4389b684b0a4d72510e1b4d398d8e6c8f4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '424d8c4389b684b0a4d72510e1b4d398d8e6c8f4', 'targets': {'smithi057.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA8igD+egu8T5w2Cky7cCBwjAqBnNHNSpnSNyV6WyAMx0iMUvZgLRFoo6ZbJ6xbU/RNnU9Rezy3NvudRDTIevaA=', 'smithi084.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMJdcvVV+6331hL+QGBTBKElA5Km24tJ7CBPfduku55yW3m7GIcWTm65BzeUaVhJkajXDrLuoDX1zvifGTc89D0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'mon': {'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'osd': {'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'client': {'debug ms': 1}, 'global': {'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}}, 'flavor': 'crimson', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'sha1': '424d8c4389b684b0a4d72510e1b4d398d8e6c8f4', 'cluster': 'ceph'}}, {'workunit': {'clients': {'client.0': ['rados/test.sh --crimson', 'rados/test_pool_quota.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-24_01:32:34', 'tube': 'smithi', 'user': 'yingxin', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-24T01:48:01.740 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-24T01:48:01.773 DEBUG:teuthology.orchestra.run.smithi084:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-24T01:48:01.788 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/run/ceph 2024-04-24T01:48:01.830 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -d -m0777 -- /var/run/ceph 2024-04-24T01:48:01.855 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T01:48:01.855 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/scratch_devs of=/dev/stdout 2024-04-24T01:48:01.914 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-24T01:48:01.914 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_1 2024-04-24T01:48:01.973 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-24T01:48:01.973 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T01:48:01.973 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-24T01:48:01.973 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T01:48:01.973 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T01:48:01.973 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-04-24 01:47:42.100252347 +0000 2024-04-24T01:48:01.973 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-04-24 01:44:13.366738190 +0000 2024-04-24T01:48:01.973 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-04-24 01:44:13.366738190 +0000 2024-04-24T01:48:01.973 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2024-04-24 01:44:13.366738190 +0000 2024-04-24T01:48:01.974 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-24T01:48:02.039 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-04-24T01:48:02.039 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-04-24T01:48:02.039 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000310995 s, 1.6 MB/s 2024-04-24T01:48:02.040 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-24T01:48:02.099 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_2 2024-04-24T01:48:02.156 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-24T01:48:02.156 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T01:48:02.156 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-24T01:48:02.156 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T01:48:02.156 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T01:48:02.156 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-04-24 01:47:42.100252347 +0000 2024-04-24T01:48:02.157 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-04-24 01:44:13.718733291 +0000 2024-04-24T01:48:02.157 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-04-24 01:44:13.718733291 +0000 2024-04-24T01:48:02.157 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2024-04-24 01:44:13.718733291 +0000 2024-04-24T01:48:02.157 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-24T01:48:02.222 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-04-24T01:48:02.222 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-04-24T01:48:02.222 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000249278 s, 2.1 MB/s 2024-04-24T01:48:02.226 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-24T01:48:02.285 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_3 2024-04-24T01:48:02.343 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-24T01:48:02.343 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T01:48:02.343 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-24T01:48:02.343 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T01:48:02.343 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T01:48:02.343 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-04-24 01:47:42.101252334 +0000 2024-04-24T01:48:02.343 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-04-24 01:44:14.080728253 +0000 2024-04-24T01:48:02.343 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-04-24 01:44:14.080728253 +0000 2024-04-24T01:48:02.343 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2024-04-24 01:44:14.080728253 +0000 2024-04-24T01:48:02.343 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-24T01:48:02.409 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-04-24T01:48:02.409 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-04-24T01:48:02.409 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000293943 s, 1.7 MB/s 2024-04-24T01:48:02.410 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-24T01:48:02.467 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_4 2024-04-24T01:48:02.525 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-24T01:48:02.525 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T01:48:02.525 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-24T01:48:02.525 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T01:48:02.525 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T01:48:02.526 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-04-24 01:47:42.101252334 +0000 2024-04-24T01:48:02.526 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-04-24 01:44:14.435723312 +0000 2024-04-24T01:48:02.526 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-04-24 01:44:14.435723312 +0000 2024-04-24T01:48:02.526 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2024-04-24 01:44:14.435723312 +0000 2024-04-24T01:48:02.526 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-24T01:48:02.591 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-04-24T01:48:02.591 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-04-24T01:48:02.591 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000289934 s, 1.8 MB/s 2024-04-24T01:48:02.592 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-24T01:48:02.650 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-04-24T01:48:02.651 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-24T01:48:02.651 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/scratch_devs of=/dev/stdout 2024-04-24T01:48:02.668 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-24T01:48:02.668 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_1 2024-04-24T01:48:02.725 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-24T01:48:02.725 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T01:48:02.725 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-24T01:48:02.725 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T01:48:02.725 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T01:48:02.725 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-04-24 01:47:57.222804569 +0000 2024-04-24T01:48:02.725 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-04-24 01:44:13.097774632 +0000 2024-04-24T01:48:02.725 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-04-24 01:44:13.097774632 +0000 2024-04-24T01:48:02.725 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-04-24 01:44:13.097774632 +0000 2024-04-24T01:48:02.726 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-24T01:48:02.789 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-04-24T01:48:02.790 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-04-24T01:48:02.790 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.00021357 s, 2.4 MB/s 2024-04-24T01:48:02.791 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-24T01:48:02.848 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_2 2024-04-24T01:48:02.904 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-24T01:48:02.904 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T01:48:02.904 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-24T01:48:02.904 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T01:48:02.904 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T01:48:02.904 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-04-24 01:47:57.222804569 +0000 2024-04-24T01:48:02.905 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-04-24 01:44:13.437768714 +0000 2024-04-24T01:48:02.905 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-04-24 01:44:13.437768714 +0000 2024-04-24T01:48:02.905 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-04-24 01:44:13.437768714 +0000 2024-04-24T01:48:02.905 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-24T01:48:02.967 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-04-24T01:48:02.967 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-04-24T01:48:02.968 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000201209 s, 2.5 MB/s 2024-04-24T01:48:02.969 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-24T01:48:03.025 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_3 2024-04-24T01:48:03.080 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-24T01:48:03.080 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T01:48:03.080 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-24T01:48:03.080 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T01:48:03.080 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T01:48:03.080 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-04-24 01:47:57.222804569 +0000 2024-04-24T01:48:03.080 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-04-24 01:44:13.779762760 +0000 2024-04-24T01:48:03.081 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-04-24 01:44:13.779762760 +0000 2024-04-24T01:48:03.081 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-04-24 01:44:13.779762760 +0000 2024-04-24T01:48:03.081 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-24T01:48:03.143 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-04-24T01:48:03.143 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-04-24T01:48:03.143 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000239404 s, 2.1 MB/s 2024-04-24T01:48:03.144 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-24T01:48:03.200 DEBUG:teuthology.orchestra.run.smithi084:> stat /dev/vg_nvme/lv_4 2024-04-24T01:48:03.256 INFO:teuthology.orchestra.run.smithi084.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-24T01:48:03.257 INFO:teuthology.orchestra.run.smithi084.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T01:48:03.257 INFO:teuthology.orchestra.run.smithi084.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-24T01:48:03.257 INFO:teuthology.orchestra.run.smithi084.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T01:48:03.257 INFO:teuthology.orchestra.run.smithi084.stdout:Context: system_u:object_r:device_t:s0 2024-04-24T01:48:03.257 INFO:teuthology.orchestra.run.smithi084.stdout:Access: 2024-04-24 01:47:57.223804552 +0000 2024-04-24T01:48:03.257 INFO:teuthology.orchestra.run.smithi084.stdout:Modify: 2024-04-24 01:44:14.117756877 +0000 2024-04-24T01:48:03.257 INFO:teuthology.orchestra.run.smithi084.stdout:Change: 2024-04-24 01:44:14.117756877 +0000 2024-04-24T01:48:03.257 INFO:teuthology.orchestra.run.smithi084.stdout: Birth: 2024-04-24 01:44:14.117756877 +0000 2024-04-24T01:48:03.257 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-24T01:48:03.319 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records in 2024-04-24T01:48:03.320 INFO:teuthology.orchestra.run.smithi084.stderr:1+0 records out 2024-04-24T01:48:03.320 INFO:teuthology.orchestra.run.smithi084.stderr:512 bytes copied, 0.000188807 s, 2.7 MB/s 2024-04-24T01:48:03.321 DEBUG:teuthology.orchestra.run.smithi084:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-24T01:48:03.377 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-04-24T01:48:03.377 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-04-24T01:48:03.377 INFO:tasks.ceph:Generating config... 2024-04-24T01:48:03.378 INFO:tasks.ceph:[mon] mon min osdmap epochs = 50 2024-04-24T01:48:03.378 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-04-24T01:48:03.379 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-04-24T01:48:03.379 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-04-24T01:48:03.379 INFO:tasks.ceph:[mon] paxos service trim min = 10 2024-04-24T01:48:03.379 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-24T01:48:03.379 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-24T01:48:03.379 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-24T01:48:03.379 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-04-24T01:48:03.379 INFO:tasks.ceph:[mon] osd pool default crimson = True 2024-04-24T01:48:03.379 INFO:tasks.ceph:[osd] debug monc = 20 2024-04-24T01:48:03.379 INFO:tasks.ceph:[osd] crimson alien thread cpu cores = 6-7 2024-04-24T01:48:03.379 INFO:tasks.ceph:[osd] crimson osd obc lru size = 10 2024-04-24T01:48:03.379 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-24T01:48:03.379 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-24T01:48:03.379 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-24T01:48:03.380 INFO:tasks.ceph:[osd] osd class default list = * 2024-04-24T01:48:03.380 INFO:tasks.ceph:[osd] osd class load list = * 2024-04-24T01:48:03.380 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-04-24T01:48:03.380 INFO:tasks.ceph:[client] debug ms = 1 2024-04-24T01:48:03.380 INFO:tasks.ceph:[global] enable experimental unrecoverable data corrupting features = crimson 2024-04-24T01:48:03.380 INFO:tasks.ceph:[global] ms client mode = crc 2024-04-24T01:48:03.380 INFO:tasks.ceph:[global] ms cluster mode = crc 2024-04-24T01:48:03.380 INFO:tasks.ceph:[global] ms mon client mode = crc 2024-04-24T01:48:03.380 INFO:tasks.ceph:[global] ms mon cluster mode = crc 2024-04-24T01:48:03.380 INFO:tasks.ceph:[global] ms mon service mode = crc 2024-04-24T01:48:03.380 INFO:tasks.ceph:[global] ms service mode = crc 2024-04-24T01:48:03.380 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-24T01:48:03.380 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-24T01:48:03.380 INFO:tasks.ceph:[osd.0] crimson seastar cpu cores = 0-2 2024-04-24T01:48:03.380 INFO:tasks.ceph:[osd.1] crimson seastar cpu cores = 3-5 2024-04-24T01:48:03.381 INFO:tasks.ceph:[osd.2] crimson seastar cpu cores = 0-2 2024-04-24T01:48:03.381 INFO:tasks.ceph:[osd.3] crimson seastar cpu cores = 3-5 2024-04-24T01:48:03.381 INFO:tasks.ceph:Setting up mon.a... 2024-04-24T01:48:03.381 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-24T01:48:03.453 INFO:teuthology.orchestra.run.smithi057.stdout:creating /etc/ceph/ceph.keyring 2024-04-24T01:48:03.454 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-24T01:48:03.509 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T01:48:03.534 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.57')] 2024-04-24T01:48:03.534 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.57', 'enable experimental unrecoverable data corrupting features': 'crimson', 'ms client mode': 'crc', 'ms cluster mode': 'crc', 'ms mon client mode': 'crc', 'ms mon cluster mode': 'crc', 'ms mon service mode': 'crc', 'ms service mode': 'crc'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug monc': 20, 'crimson alien thread cpu cores': '6-7', 'crimson osd obc lru size': 10, 'debug ms': 1, 'debug osd': 20, 'osd blocked scrub grace period': 3600, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 50, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'paxos service trim min': 10, 'mon warn on pool no app': False, 'osd pool default crimson': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1}, 'mon.a': {}, 'osd.0': {'crimson seastar cpu cores': '0-2'}, 'osd.1': {'crimson seastar cpu cores': '3-5'}, 'osd.2': {'crimson seastar cpu cores': '0-2'}, 'osd.3': {'crimson seastar cpu cores': '3-5'}} 2024-04-24T01:48:03.535 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T01:48:03.535 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-24T01:48:03.591 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.57 --print /home/ubuntu/cephtest/ceph.monmap 2024-04-24T01:48:03.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:03.683+0000 7fb728c2cf00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:03.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:03.683+0000 7fb728c2cf00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:03.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:03.683+0000 7fb728c2cf00 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:03.684 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-24T01:48:03.685 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: generated fsid 2097e8c9-9d10-45f4-a30f-1b3cf153e5e6 2024-04-24T01:48:03.685 INFO:teuthology.orchestra.run.smithi057.stdout:setting min_mon_release = quincy 2024-04-24T01:48:03.685 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 0 2024-04-24T01:48:03.685 INFO:teuthology.orchestra.run.smithi057.stdout:fsid 2097e8c9-9d10-45f4-a30f-1b3cf153e5e6 2024-04-24T01:48:03.685 INFO:teuthology.orchestra.run.smithi057.stdout:last_changed 2024-04-24T01:48:03.684947+0000 2024-04-24T01:48:03.685 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-04-24T01:48:03.684947+0000 2024-04-24T01:48:03.685 INFO:teuthology.orchestra.run.smithi057.stdout:min_mon_release 17 (quincy) 2024-04-24T01:48:03.685 INFO:teuthology.orchestra.run.smithi057.stdout:election_strategy: 1 2024-04-24T01:48:03.685 INFO:teuthology.orchestra.run.smithi057.stdout:0: [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] mon.a 2024-04-24T01:48:03.685 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-04-24T01:48:03.686 DEBUG:teuthology.orchestra.run.smithi057:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-24T01:48:03.701 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2097e8c9-9d10-45f4-a30f-1b3cf153e5e6... 2024-04-24T01:48:03.702 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-24T01:48:03.744 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-24T01:48:03.784 INFO:teuthology.orchestra.run.smithi057.stdout:[global] 2024-04-24T01:48:03.784 INFO:teuthology.orchestra.run.smithi057.stdout: chdir = "" 2024-04-24T01:48:03.784 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-24T01:48:03.784 INFO:teuthology.orchestra.run.smithi057.stdout: auth supported = cephx 2024-04-24T01:48:03.784 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:03.784 INFO:teuthology.orchestra.run.smithi057.stdout: filestore xattr use omap = true 2024-04-24T01:48:03.784 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:03.784 INFO:teuthology.orchestra.run.smithi057.stdout: mon clock drift allowed = 1.000 2024-04-24T01:48:03.784 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:03.785 INFO:teuthology.orchestra.run.smithi057.stdout: osd crush chooseleaf type = 0 2024-04-24T01:48:03.785 INFO:teuthology.orchestra.run.smithi057.stdout: auth debug = true 2024-04-24T01:48:03.785 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:03.785 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on old message = true 2024-04-24T01:48:03.785 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on bug = true 2024-04-24T01:48:03.785 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:03.785 INFO:teuthology.orchestra.run.smithi057.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-24T01:48:03.785 INFO:teuthology.orchestra.run.smithi057.stdout: mon pg warn max object skew = 0 2024-04-24T01:48:03.785 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:03.785 INFO:teuthology.orchestra.run.smithi057.stdout: # disable pg_autoscaler by default for new pools 2024-04-24T01:48:03.785 INFO:teuthology.orchestra.run.smithi057.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-24T01:48:03.785 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:03.785 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default size = 2 2024-04-24T01:48:03.785 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:03.786 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow primary affinity = true 2024-04-24T01:48:03.786 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow pg remap = true 2024-04-24T01:48:03.786 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on legacy crush tunables = false 2024-04-24T01:48:03.786 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on crush straw calc version zero = false 2024-04-24T01:48:03.786 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on no sortbitwise = false 2024-04-24T01:48:03.786 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on osd down out interval zero = false 2024-04-24T01:48:03.786 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on too few osds = false 2024-04-24T01:48:03.786 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-24T01:48:03.786 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-24T01:48:03.786 INFO:teuthology.orchestra.run.smithi057.stdout: mon_allow_pool_size_one = true 2024-04-24T01:48:03.786 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:03.786 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-24T01:48:03.786 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:03.786 INFO:teuthology.orchestra.run.smithi057.stdout: osd default data pool replay window = 5 2024-04-24T01:48:03.787 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:03.787 INFO:teuthology.orchestra.run.smithi057.stdout: mon allow pool delete = true 2024-04-24T01:48:03.787 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:03.787 INFO:teuthology.orchestra.run.smithi057.stdout: mon cluster log file level = debug 2024-04-24T01:48:03.787 INFO:teuthology.orchestra.run.smithi057.stdout: debug asserts on shutdown = true 2024-04-24T01:48:03.787 INFO:teuthology.orchestra.run.smithi057.stdout: mon health detail to clog = false 2024-04-24T01:48:03.787 INFO:teuthology.orchestra.run.smithi057.stdout: mon host = 172.21.15.57 2024-04-24T01:48:03.787 INFO:teuthology.orchestra.run.smithi057.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-04-24T01:48:03.787 INFO:teuthology.orchestra.run.smithi057.stdout: ms client mode = crc 2024-04-24T01:48:03.787 INFO:teuthology.orchestra.run.smithi057.stdout: ms cluster mode = crc 2024-04-24T01:48:03.787 INFO:teuthology.orchestra.run.smithi057.stdout: ms mon client mode = crc 2024-04-24T01:48:03.787 INFO:teuthology.orchestra.run.smithi057.stdout: ms mon cluster mode = crc 2024-04-24T01:48:03.787 INFO:teuthology.orchestra.run.smithi057.stdout: ms mon service mode = crc 2024-04-24T01:48:03.787 INFO:teuthology.orchestra.run.smithi057.stdout: ms service mode = crc 2024-04-24T01:48:03.788 INFO:teuthology.orchestra.run.smithi057.stdout: fsid = 2097e8c9-9d10-45f4-a30f-1b3cf153e5e6 2024-04-24T01:48:03.788 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:03.788 INFO:teuthology.orchestra.run.smithi057.stdout:[osd] 2024-04-24T01:48:03.788 INFO:teuthology.orchestra.run.smithi057.stdout: osd journal size = 100 2024-04-24T01:48:03.788 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:03.788 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub load threshold = 5.0 2024-04-24T01:48:03.788 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub max interval = 600 2024-04-24T01:48:03.788 INFO:teuthology.orchestra.run.smithi057.stdout: osd mclock profile = high_recovery_ops 2024-04-24T01:48:03.788 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:03.788 INFO:teuthology.orchestra.run.smithi057.stdout: osd recover clone overlap = true 2024-04-24T01:48:03.788 INFO:teuthology.orchestra.run.smithi057.stdout: osd recovery max chunk = 1048576 2024-04-24T01:48:03.788 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:03.788 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug shutdown = true 2024-04-24T01:48:03.788 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug op order = true 2024-04-24T01:48:03.788 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug verify stray on activate = true 2024-04-24T01:48:03.789 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug trim objects = true 2024-04-24T01:48:03.789 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:03.789 INFO:teuthology.orchestra.run.smithi057.stdout: osd open classes on start = true 2024-04-24T01:48:03.789 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug pg log writeout = true 2024-04-24T01:48:03.789 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:03.789 INFO:teuthology.orchestra.run.smithi057.stdout: osd deep scrub update digest min age = 30 2024-04-24T01:48:03.789 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:03.789 INFO:teuthology.orchestra.run.smithi057.stdout: osd map max advance = 10 2024-04-24T01:48:03.789 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:03.789 INFO:teuthology.orchestra.run.smithi057.stdout: journal zero on create = true 2024-04-24T01:48:03.789 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:03.789 INFO:teuthology.orchestra.run.smithi057.stdout: filestore ondisk finisher threads = 3 2024-04-24T01:48:03.789 INFO:teuthology.orchestra.run.smithi057.stdout: filestore apply finisher threads = 3 2024-04-24T01:48:03.789 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:03.790 INFO:teuthology.orchestra.run.smithi057.stdout: bdev debug aio = true 2024-04-24T01:48:03.790 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug misdirected ops = true 2024-04-24T01:48:03.790 INFO:teuthology.orchestra.run.smithi057.stdout: debug monc = 20 2024-04-24T01:48:03.790 INFO:teuthology.orchestra.run.smithi057.stdout: crimson alien thread cpu cores = 6-7 2024-04-24T01:48:03.790 INFO:teuthology.orchestra.run.smithi057.stdout: crimson osd obc lru size = 10 2024-04-24T01:48:03.790 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-04-24T01:48:03.790 INFO:teuthology.orchestra.run.smithi057.stdout: debug osd = 20 2024-04-24T01:48:03.790 INFO:teuthology.orchestra.run.smithi057.stdout: osd blocked scrub grace period = 3600 2024-04-24T01:48:03.790 INFO:teuthology.orchestra.run.smithi057.stdout: osd class default list = * 2024-04-24T01:48:03.790 INFO:teuthology.orchestra.run.smithi057.stdout: osd class load list = * 2024-04-24T01:48:03.790 INFO:teuthology.orchestra.run.smithi057.stdout: osd shutdown pgref assert = True 2024-04-24T01:48:03.791 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:03.791 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr] 2024-04-24T01:48:03.791 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-04-24T01:48:03.791 INFO:teuthology.orchestra.run.smithi057.stdout: debug mgr = 20 2024-04-24T01:48:03.791 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2024-04-24T01:48:03.791 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2024-04-24T01:48:03.791 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2024-04-24T01:48:03.791 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2024-04-24T01:48:03.791 INFO:teuthology.orchestra.run.smithi057.stdout: mgr/telemetry/nag = false 2024-04-24T01:48:03.791 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:03.791 INFO:teuthology.orchestra.run.smithi057.stdout:[mon] 2024-04-24T01:48:03.791 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-04-24T01:48:03.791 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2024-04-24T01:48:03.791 INFO:teuthology.orchestra.run.smithi057.stdout: debug paxos = 20 2024-04-24T01:48:03.792 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2024-04-24T01:48:03.792 INFO:teuthology.orchestra.run.smithi057.stdout: mon data avail warn = 5 2024-04-24T01:48:03.792 INFO:teuthology.orchestra.run.smithi057.stdout: mon mgr mkfs grace = 240 2024-04-24T01:48:03.792 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2024-04-24T01:48:03.792 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd reporter subtree level = osd 2024-04-24T01:48:03.792 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd prime pg temp = true 2024-04-24T01:48:03.792 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2024-04-24T01:48:03.792 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:03.792 INFO:teuthology.orchestra.run.smithi057.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-24T01:48:03.793 INFO:teuthology.orchestra.run.smithi057.stdout: auth mon ticket ttl = 660 # 11m 2024-04-24T01:48:03.793 INFO:teuthology.orchestra.run.smithi057.stdout: auth service ticket ttl = 240 # 4m 2024-04-24T01:48:03.793 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:03.793 INFO:teuthology.orchestra.run.smithi057.stdout: # don't complain about insecure global_id in the test suite 2024-04-24T01:48:03.793 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-24T01:48:03.793 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-24T01:48:03.793 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:03.793 INFO:teuthology.orchestra.run.smithi057.stdout: # 1m isn't quite enough 2024-04-24T01:48:03.793 INFO:teuthology.orchestra.run.smithi057.stdout: mon_down_mkfs_grace = 2m 2024-04-24T01:48:03.793 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:03.793 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_filestore_osds = false 2024-04-24T01:48:03.793 INFO:teuthology.orchestra.run.smithi057.stdout: mon min osdmap epochs = 50 2024-04-24T01:48:03.793 INFO:teuthology.orchestra.run.smithi057.stdout: mon osdmap full prune interval = 2 2024-04-24T01:48:03.793 INFO:teuthology.orchestra.run.smithi057.stdout: mon osdmap full prune min = 15 2024-04-24T01:48:03.794 INFO:teuthology.orchestra.run.smithi057.stdout: mon osdmap full prune txsize = 2 2024-04-24T01:48:03.794 INFO:teuthology.orchestra.run.smithi057.stdout: paxos service trim min = 10 2024-04-24T01:48:03.794 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on pool no app = False 2024-04-24T01:48:03.794 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default crimson = True 2024-04-24T01:48:03.794 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:03.794 INFO:teuthology.orchestra.run.smithi057.stdout:[client] 2024-04-24T01:48:03.794 INFO:teuthology.orchestra.run.smithi057.stdout: rgw cache enabled = true 2024-04-24T01:48:03.794 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable ops log = true 2024-04-24T01:48:03.794 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable usage log = true 2024-04-24T01:48:03.794 INFO:teuthology.orchestra.run.smithi057.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-24T01:48:03.794 INFO:teuthology.orchestra.run.smithi057.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-24T01:48:03.794 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-04-24T01:48:03.794 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.a] 2024-04-24T01:48:03.795 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.0] 2024-04-24T01:48:03.795 INFO:teuthology.orchestra.run.smithi057.stdout: crimson seastar cpu cores = 0-2 2024-04-24T01:48:03.795 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.1] 2024-04-24T01:48:03.795 INFO:teuthology.orchestra.run.smithi057.stdout: crimson seastar cpu cores = 3-5 2024-04-24T01:48:03.795 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.2] 2024-04-24T01:48:03.795 INFO:teuthology.orchestra.run.smithi057.stdout: crimson seastar cpu cores = 0-2 2024-04-24T01:48:03.795 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.3] 2024-04-24T01:48:03.795 INFO:teuthology.orchestra.run.smithi057.stdout: crimson seastar cpu cores = 3-5 2024-04-24T01:48:03.797 INFO:teuthology.orchestra.run.smithi084.stdout:[global] 2024-04-24T01:48:03.797 INFO:teuthology.orchestra.run.smithi084.stdout: chdir = "" 2024-04-24T01:48:03.797 INFO:teuthology.orchestra.run.smithi084.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-24T01:48:03.797 INFO:teuthology.orchestra.run.smithi084.stdout: auth supported = cephx 2024-04-24T01:48:03.797 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:03.797 INFO:teuthology.orchestra.run.smithi084.stdout: filestore xattr use omap = true 2024-04-24T01:48:03.797 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:03.797 INFO:teuthology.orchestra.run.smithi084.stdout: mon clock drift allowed = 1.000 2024-04-24T01:48:03.797 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:03.797 INFO:teuthology.orchestra.run.smithi084.stdout: osd crush chooseleaf type = 0 2024-04-24T01:48:03.798 INFO:teuthology.orchestra.run.smithi084.stdout: auth debug = true 2024-04-24T01:48:03.798 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:03.798 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on old message = true 2024-04-24T01:48:03.798 INFO:teuthology.orchestra.run.smithi084.stdout: ms die on bug = true 2024-04-24T01:48:03.798 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:03.798 INFO:teuthology.orchestra.run.smithi084.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-24T01:48:03.798 INFO:teuthology.orchestra.run.smithi084.stdout: mon pg warn max object skew = 0 2024-04-24T01:48:03.798 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:03.798 INFO:teuthology.orchestra.run.smithi084.stdout: # disable pg_autoscaler by default for new pools 2024-04-24T01:48:03.798 INFO:teuthology.orchestra.run.smithi084.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-24T01:48:03.798 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:03.798 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default size = 2 2024-04-24T01:48:03.798 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:03.798 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow primary affinity = true 2024-04-24T01:48:03.799 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd allow pg remap = true 2024-04-24T01:48:03.799 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on legacy crush tunables = false 2024-04-24T01:48:03.799 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on crush straw calc version zero = false 2024-04-24T01:48:03.799 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on no sortbitwise = false 2024-04-24T01:48:03.799 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on osd down out interval zero = false 2024-04-24T01:48:03.799 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on too few osds = false 2024-04-24T01:48:03.799 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-24T01:48:03.799 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-24T01:48:03.799 INFO:teuthology.orchestra.run.smithi084.stdout: mon_allow_pool_size_one = true 2024-04-24T01:48:03.799 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:03.799 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-24T01:48:03.799 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:03.799 INFO:teuthology.orchestra.run.smithi084.stdout: osd default data pool replay window = 5 2024-04-24T01:48:03.799 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:03.800 INFO:teuthology.orchestra.run.smithi084.stdout: mon allow pool delete = true 2024-04-24T01:48:03.800 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:03.800 INFO:teuthology.orchestra.run.smithi084.stdout: mon cluster log file level = debug 2024-04-24T01:48:03.800 INFO:teuthology.orchestra.run.smithi084.stdout: debug asserts on shutdown = true 2024-04-24T01:48:03.800 INFO:teuthology.orchestra.run.smithi084.stdout: mon health detail to clog = false 2024-04-24T01:48:03.800 INFO:teuthology.orchestra.run.smithi084.stdout: mon host = 172.21.15.57 2024-04-24T01:48:03.800 INFO:teuthology.orchestra.run.smithi084.stdout: enable experimental unrecoverable data corrupting features = crimson 2024-04-24T01:48:03.800 INFO:teuthology.orchestra.run.smithi084.stdout: ms client mode = crc 2024-04-24T01:48:03.800 INFO:teuthology.orchestra.run.smithi084.stdout: ms cluster mode = crc 2024-04-24T01:48:03.800 INFO:teuthology.orchestra.run.smithi084.stdout: ms mon client mode = crc 2024-04-24T01:48:03.800 INFO:teuthology.orchestra.run.smithi084.stdout: ms mon cluster mode = crc 2024-04-24T01:48:03.800 INFO:teuthology.orchestra.run.smithi084.stdout: ms mon service mode = crc 2024-04-24T01:48:03.800 INFO:teuthology.orchestra.run.smithi084.stdout: ms service mode = crc 2024-04-24T01:48:03.800 INFO:teuthology.orchestra.run.smithi084.stdout: fsid = 2097e8c9-9d10-45f4-a30f-1b3cf153e5e6 2024-04-24T01:48:03.801 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:03.801 INFO:teuthology.orchestra.run.smithi084.stdout:[osd] 2024-04-24T01:48:03.801 INFO:teuthology.orchestra.run.smithi084.stdout: osd journal size = 100 2024-04-24T01:48:03.801 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:03.801 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub load threshold = 5.0 2024-04-24T01:48:03.801 INFO:teuthology.orchestra.run.smithi084.stdout: osd scrub max interval = 600 2024-04-24T01:48:03.801 INFO:teuthology.orchestra.run.smithi084.stdout: osd mclock profile = high_recovery_ops 2024-04-24T01:48:03.801 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:03.801 INFO:teuthology.orchestra.run.smithi084.stdout: osd recover clone overlap = true 2024-04-24T01:48:03.801 INFO:teuthology.orchestra.run.smithi084.stdout: osd recovery max chunk = 1048576 2024-04-24T01:48:03.801 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:03.801 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug shutdown = true 2024-04-24T01:48:03.801 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug op order = true 2024-04-24T01:48:03.801 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug verify stray on activate = true 2024-04-24T01:48:03.801 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug trim objects = true 2024-04-24T01:48:03.802 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:03.802 INFO:teuthology.orchestra.run.smithi084.stdout: osd open classes on start = true 2024-04-24T01:48:03.802 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug pg log writeout = true 2024-04-24T01:48:03.802 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:03.802 INFO:teuthology.orchestra.run.smithi084.stdout: osd deep scrub update digest min age = 30 2024-04-24T01:48:03.802 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:03.803 INFO:teuthology.orchestra.run.smithi084.stdout: osd map max advance = 10 2024-04-24T01:48:03.803 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:03.803 INFO:teuthology.orchestra.run.smithi084.stdout: journal zero on create = true 2024-04-24T01:48:03.803 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:03.803 INFO:teuthology.orchestra.run.smithi084.stdout: filestore ondisk finisher threads = 3 2024-04-24T01:48:03.803 INFO:teuthology.orchestra.run.smithi084.stdout: filestore apply finisher threads = 3 2024-04-24T01:48:03.803 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:03.803 INFO:teuthology.orchestra.run.smithi084.stdout: bdev debug aio = true 2024-04-24T01:48:03.803 INFO:teuthology.orchestra.run.smithi084.stdout: osd debug misdirected ops = true 2024-04-24T01:48:03.804 INFO:teuthology.orchestra.run.smithi084.stdout: debug monc = 20 2024-04-24T01:48:03.804 INFO:teuthology.orchestra.run.smithi084.stdout: crimson alien thread cpu cores = 6-7 2024-04-24T01:48:03.804 INFO:teuthology.orchestra.run.smithi084.stdout: crimson osd obc lru size = 10 2024-04-24T01:48:03.804 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-04-24T01:48:03.804 INFO:teuthology.orchestra.run.smithi084.stdout: debug osd = 20 2024-04-24T01:48:03.804 INFO:teuthology.orchestra.run.smithi084.stdout: osd blocked scrub grace period = 3600 2024-04-24T01:48:03.804 INFO:teuthology.orchestra.run.smithi084.stdout: osd class default list = * 2024-04-24T01:48:03.804 INFO:teuthology.orchestra.run.smithi084.stdout: osd class load list = * 2024-04-24T01:48:03.804 INFO:teuthology.orchestra.run.smithi084.stdout: osd shutdown pgref assert = True 2024-04-24T01:48:03.804 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:03.804 INFO:teuthology.orchestra.run.smithi084.stdout:[mgr] 2024-04-24T01:48:03.804 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-04-24T01:48:03.804 INFO:teuthology.orchestra.run.smithi084.stdout: debug mgr = 20 2024-04-24T01:48:03.805 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2024-04-24T01:48:03.805 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2024-04-24T01:48:03.805 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2024-04-24T01:48:03.805 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2024-04-24T01:48:03.805 INFO:teuthology.orchestra.run.smithi084.stdout: mgr/telemetry/nag = false 2024-04-24T01:48:03.805 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:03.805 INFO:teuthology.orchestra.run.smithi084.stdout:[mon] 2024-04-24T01:48:03.805 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-04-24T01:48:03.805 INFO:teuthology.orchestra.run.smithi084.stdout: debug mon = 20 2024-04-24T01:48:03.805 INFO:teuthology.orchestra.run.smithi084.stdout: debug paxos = 20 2024-04-24T01:48:03.805 INFO:teuthology.orchestra.run.smithi084.stdout: debug auth = 20 2024-04-24T01:48:03.805 INFO:teuthology.orchestra.run.smithi084.stdout: mon data avail warn = 5 2024-04-24T01:48:03.805 INFO:teuthology.orchestra.run.smithi084.stdout: mon mgr mkfs grace = 240 2024-04-24T01:48:03.805 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min pgs per osd = 4 2024-04-24T01:48:03.805 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd reporter subtree level = osd 2024-04-24T01:48:03.806 INFO:teuthology.orchestra.run.smithi084.stdout: mon osd prime pg temp = true 2024-04-24T01:48:03.806 INFO:teuthology.orchestra.run.smithi084.stdout: mon reweight min bytes per osd = 10 2024-04-24T01:48:03.806 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:03.806 INFO:teuthology.orchestra.run.smithi084.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-24T01:48:03.806 INFO:teuthology.orchestra.run.smithi084.stdout: auth mon ticket ttl = 660 # 11m 2024-04-24T01:48:03.806 INFO:teuthology.orchestra.run.smithi084.stdout: auth service ticket ttl = 240 # 4m 2024-04-24T01:48:03.806 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:03.806 INFO:teuthology.orchestra.run.smithi084.stdout: # don't complain about insecure global_id in the test suite 2024-04-24T01:48:03.806 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-24T01:48:03.806 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-24T01:48:03.806 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:03.807 INFO:teuthology.orchestra.run.smithi084.stdout: # 1m isn't quite enough 2024-04-24T01:48:03.807 INFO:teuthology.orchestra.run.smithi084.stdout: mon_down_mkfs_grace = 2m 2024-04-24T01:48:03.807 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:03.807 INFO:teuthology.orchestra.run.smithi084.stdout: mon_warn_on_filestore_osds = false 2024-04-24T01:48:03.807 INFO:teuthology.orchestra.run.smithi084.stdout: mon min osdmap epochs = 50 2024-04-24T01:48:03.807 INFO:teuthology.orchestra.run.smithi084.stdout: mon osdmap full prune interval = 2 2024-04-24T01:48:03.807 INFO:teuthology.orchestra.run.smithi084.stdout: mon osdmap full prune min = 15 2024-04-24T01:48:03.807 INFO:teuthology.orchestra.run.smithi084.stdout: mon osdmap full prune txsize = 2 2024-04-24T01:48:03.807 INFO:teuthology.orchestra.run.smithi084.stdout: paxos service trim min = 10 2024-04-24T01:48:03.807 INFO:teuthology.orchestra.run.smithi084.stdout: mon warn on pool no app = False 2024-04-24T01:48:03.807 INFO:teuthology.orchestra.run.smithi084.stdout: osd pool default crimson = True 2024-04-24T01:48:03.807 INFO:teuthology.orchestra.run.smithi084.stdout: 2024-04-24T01:48:03.807 INFO:teuthology.orchestra.run.smithi084.stdout:[client] 2024-04-24T01:48:03.807 INFO:teuthology.orchestra.run.smithi084.stdout: rgw cache enabled = true 2024-04-24T01:48:03.808 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable ops log = true 2024-04-24T01:48:03.808 INFO:teuthology.orchestra.run.smithi084.stdout: rgw enable usage log = true 2024-04-24T01:48:03.808 INFO:teuthology.orchestra.run.smithi084.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-24T01:48:03.808 INFO:teuthology.orchestra.run.smithi084.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-24T01:48:03.808 INFO:teuthology.orchestra.run.smithi084.stdout: debug ms = 1 2024-04-24T01:48:03.808 INFO:teuthology.orchestra.run.smithi084.stdout:[mon.a] 2024-04-24T01:48:03.808 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.0] 2024-04-24T01:48:03.808 INFO:teuthology.orchestra.run.smithi084.stdout: crimson seastar cpu cores = 0-2 2024-04-24T01:48:03.808 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.1] 2024-04-24T01:48:03.808 INFO:teuthology.orchestra.run.smithi084.stdout: crimson seastar cpu cores = 3-5 2024-04-24T01:48:03.808 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.2] 2024-04-24T01:48:03.808 INFO:teuthology.orchestra.run.smithi084.stdout: crimson seastar cpu cores = 0-2 2024-04-24T01:48:03.808 INFO:teuthology.orchestra.run.smithi084.stdout:[osd.3] 2024-04-24T01:48:03.808 INFO:teuthology.orchestra.run.smithi084.stdout: crimson seastar cpu cores = 3-5 2024-04-24T01:48:03.809 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-24T01:48:03.809 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-24T01:48:03.900 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-24T01:48:03.900 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T01:48:03.900 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-24T01:48:03.915 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T01:48:03.915 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-24T01:48:03.970 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi057.front.sepia.ceph.com 2024-04-24T01:48:03.970 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T01:48:03.970 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-24T01:48:03.970 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T01:48:04.043 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T01:48:04.043 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-24T01:48:04.099 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi084.front.sepia.ceph.com 2024-04-24T01:48:04.099 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-24T01:48:04.099 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-24T01:48:04.099 DEBUG:teuthology.orchestra.run.smithi084:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T01:48:04.133 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-24T01:48:04.133 DEBUG:teuthology.orchestra.run.smithi084:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-24T01:48:04.189 INFO:tasks.ceph:Setting up mon nodes... 2024-04-24T01:48:04.189 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-24T01:48:04.189 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-24T01:48:04.311 INFO:teuthology.orchestra.run.smithi084.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-24T01:48:04.314 INFO:tasks.ceph:Setting up mds nodes... 2024-04-24T01:48:04.315 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-24T01:48:04.315 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-24T01:48:04.364 INFO:teuthology.orchestra.run.smithi057.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-24T01:48:04.377 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-24T01:48:04.424 INFO:teuthology.orchestra.run.smithi084.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-24T01:48:04.436 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-24T01:48:04.436 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi084.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'}} 2024-04-24T01:48:04.437 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-24T01:48:04.461 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-04-24T01:48:04.461 INFO:tasks.ceph:role: osd.0 2024-04-24T01:48:04.461 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com 2024-04-24T01:48:04.461 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-24T01:48:04.554 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T01:48:04.555 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T01:48:04.555 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T01:48:04.555 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T01:48:04.555 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T01:48:04.555 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2024-04-24T01:48:04.555 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T01:48:04.555 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T01:48:04.555 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T01:48:04.555 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T01:48:05.879 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2024-04-24T01:48:05.881 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2024-04-24T01:48:05.881 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-24T01:48:05.925 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-24T01:48:05.997 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-24T01:48:06.063 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2'} 2024-04-24T01:48:06.063 INFO:tasks.ceph:role: osd.1 2024-04-24T01:48:06.063 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi057.front.sepia.ceph.com 2024-04-24T01:48:06.063 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-24T01:48:06.157 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T01:48:06.157 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T01:48:06.157 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T01:48:06.157 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T01:48:06.158 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T01:48:06.158 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2024-04-24T01:48:06.158 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T01:48:06.158 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T01:48:06.158 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T01:48:06.158 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T01:48:07.493 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2024-04-24T01:48:07.495 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2024-04-24T01:48:07.495 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-24T01:48:07.526 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-24T01:48:07.596 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T01:48:07.899 INFO:teuthology.orchestra.run.smithi057.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-24T01:48:07.900 INFO:teuthology.orchestra.run.smithi057.stderr:INFO 2024-04-24 01:48:07,900 seastar - Reactor backend: linux-aio 2024-04-24T01:48:07.911 INFO:teuthology.orchestra.run.smithi057.stderr:==26353==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-24T01:48:08.015 INFO:teuthology.orchestra.run.smithi057.stderr:Reactor stalled for 65 ms on shard 0. Backtrace: 0x6bddd 0xb9754f9 0xb847fc0 0xb84953c 0xb849752 0xb8498a8 0xb849d71 0x3e6ef 0x5d7e1ce 0x5dcd3bb 0x5d4bf00 0x5d4c0da 0x5d4c666 0x5b9119d 0x5bac261 0x6e84bd4 0x6e963a7 0x6e97844 0x6e978c9 0x6e979cb 0x6e97ac3 0x6e97cd0 0x6e97eb6 0x6e98205 0x6e985a9 0x6e987d9 0x6e98a43 0x6e98d10 0x6e98f2e 0x6e98fe6 0x6e990ac 0x6e9918d 0x59f9a96 0x59f9ba0 0x59f9c5c 0x59f9d18 0x59f9dd4 0x59f9f21 0x59fa0ac 0x59fa46d 0x5a163ae 0xb85ac45 0xb874edf 0xb915edd 0xb91752b 0xb5f3d11 0xb5f468d 0x376291a 0x3763473 0x3602d7a 0x2958f 0x2963f 0x33ef444 2024-04-24T01:48:08.015 INFO:teuthology.orchestra.run.smithi057.stderr:kernel callstack: 2024-04-24T01:48:08.028 INFO:teuthology.orchestra.run.smithi057.stderr:INFO 2024-04-24 01:48:08,028 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-04-24T01:48:08.028 INFO:teuthology.orchestra.run.smithi057.stderr:INFO 2024-04-24 01:48:08,028 [shard 0:main] osd - get_early_config: set --cpuset 0-2 2024-04-24T01:48:08.028 INFO:teuthology.orchestra.run.smithi057.stderr:DEBUG 2024-04-24 01:48:08,029 [shard 0:main] seastar - reactor::drain 2024-04-24T01:48:08.579 INFO:teuthology.orchestra.run.smithi057.stderr:----------------------------------------------------- 2024-04-24T01:48:08.579 INFO:teuthology.orchestra.run.smithi057.stderr:Suppressions used: 2024-04-24T01:48:08.579 INFO:teuthology.orchestra.run.smithi057.stderr: count bytes template 2024-04-24T01:48:08.579 INFO:teuthology.orchestra.run.smithi057.stderr: 1 8 MallocExtension::Register 2024-04-24T01:48:08.579 INFO:teuthology.orchestra.run.smithi057.stderr:----------------------------------------------------- 2024-04-24T01:48:08.579 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-04-24T01:48:08.637 INFO:teuthology.orchestra.run.smithi057.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-24T01:48:08.640 INFO:teuthology.orchestra.run.smithi057.stderr:INFO 2024-04-24 01:48:08,641 seastar - Reactor backend: linux-aio 2024-04-24T01:48:08.649 INFO:teuthology.orchestra.run.smithi057.stderr:==26351==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-24T01:48:08.714 INFO:teuthology.orchestra.run.smithi057.stderr:Reactor stalled for 65 ms on shard 0. Backtrace: 0x6bddd 0xb9754f9 0xb847fc0 0xb84953c 0xb849752 0xb8498a8 0xb849d71 0x3e6ef 0x35b88 0x3689e 0x3619880 0x5d71217 0x5d71401 0x5dcd384 0x5d4bf00 0x5d4c434 0x5b9119d 0x5bac261 0x6e84bd4 0x6e963a7 0x6e97844 0x6e978c9 0x6e979cb 0x6e97ac3 0x6e97cd0 0x6e97eb6 0x6e98205 0x6e985a9 0x6e987d9 0x6e98a43 0x6e98d10 0x6e98f2e 0x6e98fe6 0x6e990ac 0x6e9918d 0x59f9a96 0x59f9ba0 0x59f9c5c 0x59f9d18 0x59f9dd4 0x59f9f21 0x59fa0ac 0x59fa46d 0x5a163ae 0xb85ac45 0xb874edf 0xb915edd 0xb91752b 0xb5f3d11 0xb5f468d 0x360358a 0x2958f 0x2963f 0x33ef444 2024-04-24T01:48:08.714 INFO:teuthology.orchestra.run.smithi057.stderr:kernel callstack: 2024-04-24T01:48:12.137 INFO:teuthology.orchestra.run.smithi057.stderr:----------------------------------------------------- 2024-04-24T01:48:12.137 INFO:teuthology.orchestra.run.smithi057.stderr:Suppressions used: 2024-04-24T01:48:12.137 INFO:teuthology.orchestra.run.smithi057.stderr: count bytes template 2024-04-24T01:48:12.137 INFO:teuthology.orchestra.run.smithi057.stderr: 1 8 MallocExtension::Register 2024-04-24T01:48:12.137 INFO:teuthology.orchestra.run.smithi057.stderr:----------------------------------------------------- 2024-04-24T01:48:12.137 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-04-24T01:48:12.137 INFO:teuthology.orchestra.run.smithi057.stdout:created object store /var/lib/ceph/osd/ceph-0 for osd.0 fsid 2097e8c9-9d10-45f4-a30f-1b3cf153e5e6 2024-04-24T01:48:12.162 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-24T01:48:12.187 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T01:48:12.486 INFO:teuthology.orchestra.run.smithi057.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-24T01:48:12.487 INFO:teuthology.orchestra.run.smithi057.stderr:INFO 2024-04-24 01:48:12,487 seastar - Reactor backend: linux-aio 2024-04-24T01:48:12.492 INFO:teuthology.orchestra.run.smithi057.stderr:==27161==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-24T01:48:12.596 INFO:teuthology.orchestra.run.smithi057.stderr:Reactor stalled for 65 ms on shard 0. Backtrace: 0x6bddd 0xb9754f9 0xb847fc0 0xb84953c 0xb849752 0xb8498a8 0xb849d71 0x3e6ef 0x36897 0x5d48dce 0x5d4c164 0x5d4c666 0x5b9119d 0x5bac261 0x6e84bd4 0x6e963a7 0x6e97844 0x6e978c9 0x6e979cb 0x6e97ac3 0x6e97cd0 0x6e97eb6 0x6e98205 0x6e985a9 0x6e987d9 0x6e98a43 0x6e98d10 0x6e98f2e 0x6e98fe6 0x6e990ac 0x6e9918d 0x59f9a96 0x59f9ba0 0x59f9c5c 0x59f9d18 0x59f9dd4 0x59f9f21 0x59fa0ac 0x59fa46d 0x5a163ae 0xb85ac45 0xb874edf 0xb915edd 0xb91752b 0xb5f3d11 0xb5f468d 0x376291a 0x3763473 0x3602d7a 0x2958f 0x2963f 0x33ef444 2024-04-24T01:48:12.596 INFO:teuthology.orchestra.run.smithi057.stderr:kernel callstack: 2024-04-24T01:48:12.608 INFO:teuthology.orchestra.run.smithi057.stderr:INFO 2024-04-24 01:48:12,608 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-04-24T01:48:12.608 INFO:teuthology.orchestra.run.smithi057.stderr:INFO 2024-04-24 01:48:12,608 [shard 0:main] osd - get_early_config: set --cpuset 3-5 2024-04-24T01:48:12.608 INFO:teuthology.orchestra.run.smithi057.stderr:DEBUG 2024-04-24 01:48:12,609 [shard 0:main] seastar - reactor::drain 2024-04-24T01:48:13.166 INFO:teuthology.orchestra.run.smithi057.stderr:----------------------------------------------------- 2024-04-24T01:48:13.167 INFO:teuthology.orchestra.run.smithi057.stderr:Suppressions used: 2024-04-24T01:48:13.167 INFO:teuthology.orchestra.run.smithi057.stderr: count bytes template 2024-04-24T01:48:13.167 INFO:teuthology.orchestra.run.smithi057.stderr: 1 8 MallocExtension::Register 2024-04-24T01:48:13.167 INFO:teuthology.orchestra.run.smithi057.stderr:----------------------------------------------------- 2024-04-24T01:48:13.167 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-04-24T01:48:13.227 INFO:teuthology.orchestra.run.smithi057.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-24T01:48:13.230 INFO:teuthology.orchestra.run.smithi057.stderr:INFO 2024-04-24 01:48:13,231 seastar - Reactor backend: linux-aio 2024-04-24T01:48:13.239 INFO:teuthology.orchestra.run.smithi057.stderr:==27159==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-24T01:48:13.304 INFO:teuthology.orchestra.run.smithi057.stderr:Reactor stalled for 65 ms on shard 0. Backtrace: 0x6bddd 0xb9754f9 0xb847fc0 0xb84953c 0xb849752 0xb8498a8 0xb849d71 0x3e6ef 0x8b51c 0xef7ec 0x4a0a5 0x35b7c 0x3629e 0x5d7e304 0x5d7e500 0x5d7e6fd 0x5d7e9d3 0x5dcd213 0x5dcd419 0x5d4bf00 0x5d4c0da 0x5d4c666 0x5b9119d 0x5bac261 0x6e84bd4 0x6e963a7 0x6e97844 0x6e978c9 0x6e979cb 0x6e97ac3 0x6e97cd0 0x6e97eb6 0x6e98205 0x6e985a9 0x6e987d9 0x6e98a43 0x6e98d10 0x6e98f2e 0x6e98fe6 0x6e990ac 0x6e9918d 0x59f9a96 0x59f9ba0 0x59f9c5c 0x59f9d18 0x59f9dd4 0x59f9f21 0x59fa0ac 0x59fa46d 0x5a163ae 0xb85ac45 0xb874edf 0xb915edd 0xb91752b 0xb5f3d11 0xb5f468d 0x360358a 0x2958f 0x2963f 0x33ef444 2024-04-24T01:48:13.304 INFO:teuthology.orchestra.run.smithi057.stderr:kernel callstack: 2024-04-24T01:48:16.760 INFO:teuthology.orchestra.run.smithi057.stderr:----------------------------------------------------- 2024-04-24T01:48:16.760 INFO:teuthology.orchestra.run.smithi057.stderr:Suppressions used: 2024-04-24T01:48:16.760 INFO:teuthology.orchestra.run.smithi057.stderr: count bytes template 2024-04-24T01:48:16.760 INFO:teuthology.orchestra.run.smithi057.stderr: 1 8 MallocExtension::Register 2024-04-24T01:48:16.761 INFO:teuthology.orchestra.run.smithi057.stderr:----------------------------------------------------- 2024-04-24T01:48:16.761 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-04-24T01:48:16.761 INFO:teuthology.orchestra.run.smithi057.stdout:created object store /var/lib/ceph/osd/ceph-1 for osd.1 fsid 2097e8c9-9d10-45f4-a30f-1b3cf153e5e6 2024-04-24T01:48:16.785 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-24T01:48:16.810 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-24T01:48:16.839 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-04-24T01:48:16.839 INFO:tasks.ceph:role: osd.2 2024-04-24T01:48:16.839 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com 2024-04-24T01:48:16.839 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-24T01:48:16.914 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T01:48:16.914 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T01:48:16.914 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T01:48:16.914 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T01:48:16.914 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T01:48:16.914 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2024-04-24T01:48:16.914 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T01:48:16.915 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T01:48:16.915 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T01:48:16.915 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T01:48:17.425 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2024-04-24T01:48:17.427 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2024-04-24T01:48:17.427 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-24T01:48:17.528 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-24T01:48:17.559 DEBUG:teuthology.orchestra.run.smithi084:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-24T01:48:17.624 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2'} 2024-04-24T01:48:17.625 INFO:tasks.ceph:role: osd.3 2024-04-24T01:48:17.625 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com 2024-04-24T01:48:17.625 DEBUG:teuthology.orchestra.run.smithi084:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-24T01:48:17.697 INFO:teuthology.orchestra.run.smithi084.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T01:48:17.697 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T01:48:17.697 INFO:teuthology.orchestra.run.smithi084.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T01:48:17.697 INFO:teuthology.orchestra.run.smithi084.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-24T01:48:17.697 INFO:teuthology.orchestra.run.smithi084.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T01:48:17.697 INFO:teuthology.orchestra.run.smithi084.stdout: = sunit=0 swidth=0 blks 2024-04-24T01:48:17.697 INFO:teuthology.orchestra.run.smithi084.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T01:48:17.697 INFO:teuthology.orchestra.run.smithi084.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-24T01:48:17.697 INFO:teuthology.orchestra.run.smithi084.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T01:48:17.698 INFO:teuthology.orchestra.run.smithi084.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T01:48:18.148 INFO:teuthology.orchestra.run.smithi084.stdout:Discarding blocks...Done. 2024-04-24T01:48:18.149 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi084.front.sepia.ceph.com -o noatime 2024-04-24T01:48:18.150 DEBUG:teuthology.orchestra.run.smithi084:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2024-04-24T01:48:18.222 DEBUG:teuthology.orchestra.run.smithi084:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-24T01:48:18.291 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T01:48:18.596 INFO:teuthology.orchestra.run.smithi084.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-24T01:48:18.597 INFO:teuthology.orchestra.run.smithi084.stderr:INFO 2024-04-24 01:48:18,597 seastar - Reactor backend: linux-aio 2024-04-24T01:48:18.612 INFO:teuthology.orchestra.run.smithi084.stderr:==26204==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-24T01:48:18.714 INFO:teuthology.orchestra.run.smithi084.stderr:Reactor stalled for 65 ms on shard 0. Backtrace: 0x6bddd 0xb9754f9 0xb847fc0 0xb84953c 0xb849752 0xb8498a8 0xb849d71 0x3e6ef 0xc9c2e 0xca7a6 0x3409b78 0x376c2ed 0x59a164f 0x59a46bd 0x5bfd237 0x5bfe863 0x5bfea24 0x5ba81c9 0x6e84c43 0x6e963a7 0x6e97844 0x6e978c9 0x6e979cb 0x6e97ac3 0x6e97cd0 0x6e97eb6 0x6e98205 0x6e985a9 0x6e987d9 0x6e98a43 0x6e98d10 0x6e98f2e 0x6e98fe6 0x6e990ac 0x6e9918d 0x59f9a96 0x59f9ba0 0x59f9c5c 0x59f9d18 0x59f9dd4 0x59f9f21 0x59fa0ac 0x59fa46d 0x5a163ae 0xb85ac45 0xb874edf 0xb915edd 0xb91752b 0xb5f3d11 0xb5f468d 0x376291a 0x3763473 0x3602d7a 0x2958f 0x2963f 0x33ef444 2024-04-24T01:48:18.714 INFO:teuthology.orchestra.run.smithi084.stderr:kernel callstack: 2024-04-24T01:48:18.719 INFO:teuthology.orchestra.run.smithi084.stderr:INFO 2024-04-24 01:48:18,720 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-04-24T01:48:18.719 INFO:teuthology.orchestra.run.smithi084.stderr:INFO 2024-04-24 01:48:18,720 [shard 0:main] osd - get_early_config: set --cpuset 0-2 2024-04-24T01:48:18.720 INFO:teuthology.orchestra.run.smithi084.stderr:DEBUG 2024-04-24 01:48:18,720 [shard 0:main] seastar - reactor::drain 2024-04-24T01:48:19.267 INFO:teuthology.orchestra.run.smithi084.stderr:----------------------------------------------------- 2024-04-24T01:48:19.267 INFO:teuthology.orchestra.run.smithi084.stderr:Suppressions used: 2024-04-24T01:48:19.267 INFO:teuthology.orchestra.run.smithi084.stderr: count bytes template 2024-04-24T01:48:19.268 INFO:teuthology.orchestra.run.smithi084.stderr: 1 8 MallocExtension::Register 2024-04-24T01:48:19.268 INFO:teuthology.orchestra.run.smithi084.stderr:----------------------------------------------------- 2024-04-24T01:48:19.268 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-04-24T01:48:19.330 INFO:teuthology.orchestra.run.smithi084.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-24T01:48:19.334 INFO:teuthology.orchestra.run.smithi084.stderr:INFO 2024-04-24 01:48:19,334 seastar - Reactor backend: linux-aio 2024-04-24T01:48:19.342 INFO:teuthology.orchestra.run.smithi084.stderr:==26202==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-24T01:48:22.760 INFO:teuthology.orchestra.run.smithi084.stderr:----------------------------------------------------- 2024-04-24T01:48:22.760 INFO:teuthology.orchestra.run.smithi084.stderr:Suppressions used: 2024-04-24T01:48:22.760 INFO:teuthology.orchestra.run.smithi084.stderr: count bytes template 2024-04-24T01:48:22.760 INFO:teuthology.orchestra.run.smithi084.stderr: 1 8 MallocExtension::Register 2024-04-24T01:48:22.760 INFO:teuthology.orchestra.run.smithi084.stderr:----------------------------------------------------- 2024-04-24T01:48:22.760 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-04-24T01:48:22.761 INFO:teuthology.orchestra.run.smithi084.stdout:created object store /var/lib/ceph/osd/ceph-2 for osd.2 fsid 2097e8c9-9d10-45f4-a30f-1b3cf153e5e6 2024-04-24T01:48:22.785 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-24T01:48:22.809 DEBUG:teuthology.orchestra.run.smithi084:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T01:48:23.095 INFO:teuthology.orchestra.run.smithi084.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-24T01:48:23.096 INFO:teuthology.orchestra.run.smithi084.stderr:INFO 2024-04-24 01:48:23,096 seastar - Reactor backend: linux-aio 2024-04-24T01:48:23.101 INFO:teuthology.orchestra.run.smithi084.stderr:==27013==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-24T01:48:23.209 INFO:teuthology.orchestra.run.smithi084.stderr:INFO 2024-04-24 01:48:23,209 [shard 0:main] osd - bypassing the config fetch due to --no-mon-config 2024-04-24T01:48:23.209 INFO:teuthology.orchestra.run.smithi084.stderr:INFO 2024-04-24 01:48:23,209 [shard 0:main] osd - get_early_config: set --cpuset 3-5 2024-04-24T01:48:23.209 INFO:teuthology.orchestra.run.smithi084.stderr:DEBUG 2024-04-24 01:48:23,210 [shard 0:main] seastar - reactor::drain 2024-04-24T01:48:23.740 INFO:teuthology.orchestra.run.smithi084.stderr:----------------------------------------------------- 2024-04-24T01:48:23.740 INFO:teuthology.orchestra.run.smithi084.stderr:Suppressions used: 2024-04-24T01:48:23.740 INFO:teuthology.orchestra.run.smithi084.stderr: count bytes template 2024-04-24T01:48:23.740 INFO:teuthology.orchestra.run.smithi084.stderr: 1 8 MallocExtension::Register 2024-04-24T01:48:23.740 INFO:teuthology.orchestra.run.smithi084.stderr:----------------------------------------------------- 2024-04-24T01:48:23.740 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-04-24T01:48:23.802 INFO:teuthology.orchestra.run.smithi084.stderr:WARNING: debug mode. Not for benchmarking or production 2024-04-24T01:48:23.805 INFO:teuthology.orchestra.run.smithi084.stderr:INFO 2024-04-24 01:48:23,806 seastar - Reactor backend: linux-aio 2024-04-24T01:48:23.819 INFO:teuthology.orchestra.run.smithi084.stderr:==27011==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases! 2024-04-24T01:48:23.924 INFO:teuthology.orchestra.run.smithi084.stderr:Reactor stalled for 65 ms on shard 0. Backtrace: 0x6bddd 0xb9754f9 0xb847fc0 0xb84953c 0xb849752 0xb8498a8 0xb849d71 0x3e6ef 0x2dc12 0x29edb 0xdfdb3 0x341bdf3 0x341bffc 0x344966d 0x36370ee 0x3f734b7 0x5d4bede 0x5ba421b 0x5ba50d0 0x5ba521b 0x3618a46 0x6e96d2d 0x6e97844 0x6e978c9 0x6e979cb 0x6e97ac3 0x6e97cd0 0x6e97eb6 0x6e98205 0x6e985a9 0x6e987d9 0x6e98a43 0x6e98d10 0x6e98f2e 0x6e98fe6 0x6e990ac 0x6e9918d 0x59f9a96 0x59f9ba0 0x59f9c5c 0x59f9d18 0x59f9dd4 0x59f9f21 0x59fa0ac 0x59fa46d 0x5a163ae 0xb85ac45 0xb874edf 0xb915edd 0xb91752b 0xb5f3d11 0xb5f468d 0x360358a 0x2958f 0x2963f 0x33ef444 2024-04-24T01:48:23.925 INFO:teuthology.orchestra.run.smithi084.stderr:kernel callstack: 2024-04-24T01:48:27.275 INFO:teuthology.orchestra.run.smithi084.stderr:----------------------------------------------------- 2024-04-24T01:48:27.275 INFO:teuthology.orchestra.run.smithi084.stderr:Suppressions used: 2024-04-24T01:48:27.275 INFO:teuthology.orchestra.run.smithi084.stderr: count bytes template 2024-04-24T01:48:27.276 INFO:teuthology.orchestra.run.smithi084.stderr: 1 8 MallocExtension::Register 2024-04-24T01:48:27.276 INFO:teuthology.orchestra.run.smithi084.stderr:----------------------------------------------------- 2024-04-24T01:48:27.276 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-04-24T01:48:27.276 INFO:teuthology.orchestra.run.smithi084.stdout:created object store /var/lib/ceph/osd/ceph-3 for osd.3 fsid 2097e8c9-9d10-45f4-a30f-1b3cf153e5e6 2024-04-24T01:48:27.299 DEBUG:teuthology.orchestra.run.smithi084:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-24T01:48:27.322 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-24T01:48:27.322 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T01:48:27.322 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-24T01:48:27.352 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T01:48:27.352 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-24T01:48:27.420 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-24T01:48:27.420 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-24T01:48:27.443 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-24T01:48:27.443 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-24T01:48:27.506 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-24T01:48:27.506 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-24T01:48:27.569 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T01:48:27.569 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-24T01:48:27.587 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-24T01:48:27.587 DEBUG:teuthology.orchestra.run.smithi084:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-24T01:48:27.624 INFO:tasks.ceph:Adding keys to all mons... 2024-04-24T01:48:27.624 DEBUG:teuthology.orchestra.run.smithi057:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-24T01:48:27.653 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.0] 2024-04-24T01:48:27.653 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDYZChmiMQxLxAAPqP+rF2bvRzabaQxfYJBeA== 2024-04-24T01:48:27.653 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.1] 2024-04-24T01:48:27.653 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDdZChmSTb6FhAAY/45Bv1cC7/ildxYzDTRsg== 2024-04-24T01:48:27.653 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr.x] 2024-04-24T01:48:27.653 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDUZChmgBmfEhAARzny3v+olpF4aEgjYb9AnQ== 2024-04-24T01:48:27.653 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.2] 2024-04-24T01:48:27.653 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDjZChmNAtXHBAADllutRX6ZbfDHDFB4qBgEw== 2024-04-24T01:48:27.653 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.3] 2024-04-24T01:48:27.654 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDnZChmrj/uORAArC5IgordIwmKJo0oMyT3SQ== 2024-04-24T01:48:27.654 INFO:teuthology.orchestra.run.smithi057.stdout:[client.0] 2024-04-24T01:48:27.654 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDUZChm9wvBFRAA7HpOSuY+ON2z8mkiPym8Yw== 2024-04-24T01:48:27.654 INFO:teuthology.orchestra.run.smithi057.stdout:[client.1] 2024-04-24T01:48:27.654 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDUZChmZlVRGRAAvRBMc7flc1YM49oAveSTIQ== 2024-04-24T01:48:27.655 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T01:48:27.762 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T01:48:27.826 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-24T01:48:27.887 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T01:48:27.947 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T01:48:28.007 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T01:48:28.070 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T01:48:28.133 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-24T01:48:28.133 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-24T01:48:28.157 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-24T01:48:28.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.258+0000 7f4163763a80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:28.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.258+0000 7f4163763a80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:28.285 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-24T01:48:28.309 DEBUG:teuthology.orchestra.run.smithi057:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-24T01:48:28.365 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-24T01:48:28.365 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-24T01:48:28.365 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-24T01:48:28.407 INFO:tasks.ceph.mon.a:Started 2024-04-24T01:48:28.407 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-24T01:48:28.408 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-24T01:48:28.408 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-24T01:48:28.410 INFO:tasks.ceph.mgr.x:Started 2024-04-24T01:48:28.410 INFO:tasks.ceph:Setting crush tunables to default 2024-04-24T01:48:28.411 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd crush tunables default 2024-04-24T01:48:28.490 INFO:tasks.ceph.mon.a.smithi057.stderr:2024-04-24T01:48:28.489+0000 7f59e8563a80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:28.490 INFO:tasks.ceph.mon.a.smithi057.stderr:2024-04-24T01:48:28.489+0000 7f59e8563a80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:28.490 INFO:tasks.ceph.mon.a.smithi057.stderr:2024-04-24T01:48:28.489+0000 7f59e8563a80 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:28.500 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-04-24T01:48:28.500+0000 7f7933031000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:28.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.513+0000 7fe396a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:28.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.520+0000 7fe396a6d640 1 Processor -- start 2024-04-24T01:48:28.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.520+0000 7fe396a6d640 1 -- start start 2024-04-24T01:48:28.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.522+0000 7fe396a6d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe390071440 0x7fe390132ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:28.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.522+0000 7fe396a6d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3900a4970 con 0x7fe390071030 2024-04-24T01:48:28.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.522+0000 7fe396a6d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fe390070a00 con 0x7fe390071440 2024-04-24T01:48:28.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.522+0000 7fe38ffff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe390071440 0x7fe390132ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:28.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.522+0000 7fe394809640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe390071030 0x7fe3901327b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57058/0 (socket says 172.21.15.57:57058) 2024-04-24T01:48:28.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.522+0000 7fe394809640 1 -- 172.21.15.57:0/3761657906 learned_addr learned my addr 172.21.15.57:0/3761657906 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T01:48:28.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.522+0000 7fe38ffff640 1 -- 172.21.15.57:0/3761657906 >> v2:172.21.15.57:3300/0 conn(0x7fe390071440 msgr2=0x7fe390132ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-24T01:48:28.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.522+0000 7fe38ffff640 1 -- 172.21.15.57:0/3761657906 >> v2:172.21.15.57:3300/0 conn(0x7fe390071440 msgr2=0x7fe390132ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-24T01:48:28.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.522+0000 7fe38ffff640 1 --2- 172.21.15.57:0/3761657906 >> v2:172.21.15.57:3300/0 conn(0x7fe390071440 0x7fe390132ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-24T01:48:28.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.522+0000 7fe38ffff640 1 --2- 172.21.15.57:0/3761657906 >> v2:172.21.15.57:3300/0 conn(0x7fe390071440 0x7fe390132ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-24T01:48:28.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.524+0000 7fe38f7fe640 1 -- 172.21.15.57:0/3761657906 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2624208959 0 0) 0x7fe3900a4970 con 0x7fe390071030 2024-04-24T01:48:28.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.524+0000 7fe38f7fe640 1 -- 172.21.15.57:0/3761657906 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe380003580 con 0x7fe390071030 2024-04-24T01:48:28.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.524+0000 7fe38f7fe640 1 -- 172.21.15.57:0/3761657906 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 724510255 0 0) 0x7fe380003580 con 0x7fe390071030 2024-04-24T01:48:28.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.525+0000 7fe38f7fe640 1 -- 172.21.15.57:0/3761657906 >> v2:172.21.15.57:3300/0 conn(0x7fe390071440 msgr2=0x7fe390132ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-24T01:48:28.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.525+0000 7fe38f7fe640 1 --2- 172.21.15.57:0/3761657906 >> v2:172.21.15.57:3300/0 conn(0x7fe390071440 0x7fe390132ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:28.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.525+0000 7fe38f7fe640 1 -- 172.21.15.57:0/3761657906 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3900a4550 con 0x7fe390071030 2024-04-24T01:48:28.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.525+0000 7fe38f7fe640 1 -- 172.21.15.57:0/3761657906 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 2240345546 0 0) 0x7fe3840015a0 con 0x7fe390071030 2024-04-24T01:48:28.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.525+0000 7fe38f7fe640 1 -- 172.21.15.57:0/3761657906 >> v1:172.21.15.57:6789/0 conn(0x7fe390071030 legacy=0x7fe3901327b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:28.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.525+0000 7fe38f7fe640 1 --2- 172.21.15.57:0/3761657906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3800039d0 0x7fe380003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:28.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.525+0000 7fe38f7fe640 1 -- 172.21.15.57:0/3761657906 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe390070a00 con 0x7fe3800039d0 2024-04-24T01:48:28.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.525+0000 7fe394809640 1 --2- 172.21.15.57:0/3761657906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3800039d0 0x7fe380003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:28.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.525+0000 7fe394809640 1 -- 172.21.15.57:0/3761657906 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe380003580 con 0x7fe3800039d0 2024-04-24T01:48:28.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.526+0000 7fe394809640 1 --2- 172.21.15.57:0/3761657906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3800039d0 0x7fe380003e20 crc :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59d6127683555c80 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:28.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.526+0000 7fe38f7fe640 1 -- 172.21.15.57:0/3761657906 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe384007cc0 con 0x7fe3800039d0 2024-04-24T01:48:28.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.526+0000 7fe38f7fe640 1 -- 172.21.15.57:0/3761657906 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe384005930 con 0x7fe3800039d0 2024-04-24T01:48:28.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.526+0000 7fe38f7fe640 1 -- 172.21.15.57:0/3761657906 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe384005bd0 con 0x7fe3800039d0 2024-04-24T01:48:28.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.527+0000 7fe396a6d640 1 -- 172.21.15.57:0/3761657906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3800039d0 msgr2=0x7fe380003e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:28.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.527+0000 7fe396a6d640 1 --2- 172.21.15.57:0/3761657906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3800039d0 0x7fe380003e20 crc :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:28.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.527+0000 7fe396a6d640 1 -- 172.21.15.57:0/3761657906 shutdown_connections 2024-04-24T01:48:28.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.527+0000 7fe396a6d640 1 --2- 172.21.15.57:0/3761657906 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3800039d0 0x7fe380003e20 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:28.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.527+0000 7fe396a6d640 1 --2- 172.21.15.57:0/3761657906 >> v2:172.21.15.57:3300/0 conn(0x7fe390071440 0x7fe390132ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:28.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.527+0000 7fe396a6d640 1 -- 172.21.15.57:0/3761657906 >> 172.21.15.57:0/3761657906 conn(0x7fe3900a2a20 msgr2=0x7fe3900a2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:28.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.527+0000 7fe396a6d640 1 -- 172.21.15.57:0/3761657906 shutdown_connections 2024-04-24T01:48:28.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.527+0000 7fe396a6d640 1 -- 172.21.15.57:0/3761657906 wait complete. 2024-04-24T01:48:28.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.527+0000 7fe396a6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:28.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.529+0000 7fe396a6d640 1 Processor -- start 2024-04-24T01:48:28.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.529+0000 7fe396a6d640 1 -- start start 2024-04-24T01:48:28.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.531+0000 7fe396a6d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3800039d0 0x7fe3901c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:28.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.531+0000 7fe396a6d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe39011e4b0 con 0x7fe3800039d0 2024-04-24T01:48:28.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.531+0000 7fe394809640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3800039d0 0x7fe3901c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:28.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.531+0000 7fe394809640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3800039d0 0x7fe3901c7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:41146/0 (socket says 172.21.15.57:41146) 2024-04-24T01:48:28.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.531+0000 7fe394809640 1 -- 172.21.15.57:0/2208048538 learned_addr learned my addr 172.21.15.57:0/2208048538 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T01:48:28.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.531+0000 7fe394809640 1 -- 172.21.15.57:0/2208048538 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe39011e910 con 0x7fe3800039d0 2024-04-24T01:48:28.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.531+0000 7fe394809640 1 --2- 172.21.15.57:0/2208048538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3800039d0 0x7fe3901c7750 crc :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:28.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.532+0000 7fe38d7fa640 1 -- 172.21.15.57:0/2208048538 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe384001430 con 0x7fe3800039d0 2024-04-24T01:48:28.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.532+0000 7fe38d7fa640 1 -- 172.21.15.57:0/2208048538 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe384001590 con 0x7fe3800039d0 2024-04-24T01:48:28.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.532+0000 7fe38d7fa640 1 -- 172.21.15.57:0/2208048538 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe384007c10 con 0x7fe3800039d0 2024-04-24T01:48:28.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.532+0000 7fe396a6d640 1 -- 172.21.15.57:0/2208048538 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3901c70a0 con 0x7fe3800039d0 2024-04-24T01:48:28.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.532+0000 7fe396a6d640 1 -- 172.21.15.57:0/2208048538 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe39011fce0 con 0x7fe3800039d0 2024-04-24T01:48:28.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.532+0000 7fe38d7fa640 1 -- 172.21.15.57:0/2208048538 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7fe3840167b0 con 0x7fe3800039d0 2024-04-24T01:48:28.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.533+0000 7fe38d7fa640 1 -- 172.21.15.57:0/2208048538 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (crc 0 0 0) 0x7fe384015dd0 con 0x7fe3800039d0 2024-04-24T01:48:28.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.533+0000 7fe396a6d640 1 -- 172.21.15.57:0/2208048538 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3901c7550 con 0x7fe3800039d0 2024-04-24T01:48:28.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.536+0000 7fe38d7fa640 1 -- 172.21.15.57:0/2208048538 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7fe384016c40 con 0x7fe3800039d0 2024-04-24T01:48:28.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.601+0000 7fe396a6d640 1 -- 172.21.15.57:0/2208048538 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fe390063900 con 0x7fe3800039d0 2024-04-24T01:48:28.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.603+0000 7fe38d7fa640 1 -- 172.21.15.57:0/2208048538 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (crc 0 0 0) 0x7fe3840153b0 con 0x7fe3800039d0 2024-04-24T01:48:28.604 INFO:teuthology.orchestra.run.smithi057.stderr:adjusted tunables profile to default 2024-04-24T01:48:28.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.603+0000 7fe396a6d640 1 -- 172.21.15.57:0/2208048538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3800039d0 msgr2=0x7fe3901c7750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:28.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.603+0000 7fe396a6d640 1 --2- 172.21.15.57:0/2208048538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3800039d0 0x7fe3901c7750 crc :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:28.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.604+0000 7fe396a6d640 1 -- 172.21.15.57:0/2208048538 shutdown_connections 2024-04-24T01:48:28.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.604+0000 7fe396a6d640 1 --2- 172.21.15.57:0/2208048538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe3800039d0 0x7fe3901c7750 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:28.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.604+0000 7fe396a6d640 1 -- 172.21.15.57:0/2208048538 >> 172.21.15.57:0/2208048538 conn(0x7fe3900a2a20 msgr2=0x7fe3901ba810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:28.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.604+0000 7fe396a6d640 1 -- 172.21.15.57:0/2208048538 shutdown_connections 2024-04-24T01:48:28.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.604+0000 7fe396a6d640 1 -- 172.21.15.57:0/2208048538 wait complete. 2024-04-24T01:48:28.615 INFO:tasks.ceph:check_enable_crimson: True 2024-04-24T01:48:28.615 INFO:tasks.ceph:check_enable_crimson: setting set-allow-crimson 2024-04-24T01:48:28.615 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd set-allow-crimson --yes-i-really-mean-it 2024-04-24T01:48:28.705 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-04-24T01:48:28.705+0000 7f7933031000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:28.705 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-04-24T01:48:28.705+0000 7f7933031000 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:28.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.718+0000 7f055639d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:28.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.724+0000 7f055639d640 1 Processor -- start 2024-04-24T01:48:28.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.724+0000 7f055639d640 1 -- start start 2024-04-24T01:48:28.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.726+0000 7f055639d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0550137c50 0x7f055013a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:28.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.726+0000 7f055639d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05500a0000 con 0x7f055009e710 2024-04-24T01:48:28.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.726+0000 7f055639d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f055009e3c0 con 0x7f0550137c50 2024-04-24T01:48:28.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.726+0000 7f054ffff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f055009e710 0x7f05500a0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46616/0 (socket says 172.21.15.57:46616) 2024-04-24T01:48:28.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.726+0000 7f054ffff640 1 -- 172.21.15.57:0/3010083979 learned_addr learned my addr 172.21.15.57:0/3010083979 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T01:48:28.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.726+0000 7f054f7fe640 1 --2- 172.21.15.57:0/3010083979 >> v2:172.21.15.57:3300/0 conn(0x7f0550137c50 0x7f055013a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:28.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.726+0000 7f054effd640 1 -- 172.21.15.57:0/3010083979 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 506006309 0 0) 0x7f05500a0000 con 0x7f055009e710 2024-04-24T01:48:28.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.726+0000 7f054effd640 1 -- 172.21.15.57:0/3010083979 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f053c003580 con 0x7f055009e710 2024-04-24T01:48:28.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.726+0000 7f054f7fe640 1 -- 172.21.15.57:0/3010083979 >> v1:172.21.15.57:6789/0 conn(0x7f055009e710 legacy=0x7f05500a0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:28.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.726+0000 7f054f7fe640 1 -- 172.21.15.57:0/3010083979 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05500a0730 con 0x7f0550137c50 2024-04-24T01:48:28.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.726+0000 7f054f7fe640 1 --2- 172.21.15.57:0/3010083979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0550137c50 0x7f055013a070 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7194b6f06e9bafc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:28.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.726+0000 7f054effd640 1 -- 172.21.15.57:0/3010083979 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0538009d80 con 0x7f0550137c50 2024-04-24T01:48:28.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.726+0000 7f054effd640 1 -- 172.21.15.57:0/3010083979 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f053800e230 con 0x7f0550137c50 2024-04-24T01:48:28.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.726+0000 7f054effd640 1 -- 172.21.15.57:0/3010083979 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f053800e4d0 con 0x7f0550137c50 2024-04-24T01:48:28.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.727+0000 7f055639d640 1 -- 172.21.15.57:0/3010083979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0550137c50 msgr2=0x7f055013a070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:28.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.727+0000 7f055639d640 1 --2- 172.21.15.57:0/3010083979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0550137c50 0x7f055013a070 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:28.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.727+0000 7f055639d640 1 -- 172.21.15.57:0/3010083979 shutdown_connections 2024-04-24T01:48:28.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.727+0000 7f055639d640 1 --2- 172.21.15.57:0/3010083979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0550137c50 0x7f055013a070 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:28.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.727+0000 7f055639d640 1 -- 172.21.15.57:0/3010083979 >> 172.21.15.57:0/3010083979 conn(0x7f05500a3af0 msgr2=0x7f05500a3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:28.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.727+0000 7f055639d640 1 -- 172.21.15.57:0/3010083979 shutdown_connections 2024-04-24T01:48:28.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.727+0000 7f055639d640 1 -- 172.21.15.57:0/3010083979 wait complete. 2024-04-24T01:48:28.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.727+0000 7f055639d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:28.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.729+0000 7f055639d640 1 Processor -- start 2024-04-24T01:48:28.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.729+0000 7f055639d640 1 -- start start 2024-04-24T01:48:28.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.731+0000 7f055639d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0550137c50 0x7f055011f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:28.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.731+0000 7f055639d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0550120800 con 0x7f0550137c50 2024-04-24T01:48:28.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.731+0000 7f054ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0550137c50 0x7f055011f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:28.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.731+0000 7f054ffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0550137c50 0x7f055011f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40700/0 (socket says 172.21.15.57:40700) 2024-04-24T01:48:28.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.731+0000 7f054ffff640 1 -- 172.21.15.57:0/1019505176 learned_addr learned my addr 172.21.15.57:0/1019505176 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T01:48:28.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.731+0000 7f054ffff640 1 -- 172.21.15.57:0/1019505176 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0550122c80 con 0x7f0550137c50 2024-04-24T01:48:28.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.731+0000 7f054ffff640 1 --2- 172.21.15.57:0/1019505176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0550137c50 0x7f055011f670 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:28.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.731+0000 7f054cff9640 1 -- 172.21.15.57:0/1019505176 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0540005a60 con 0x7f0550137c50 2024-04-24T01:48:28.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.732+0000 7f054cff9640 1 -- 172.21.15.57:0/1019505176 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0540005bc0 con 0x7f0550137c50 2024-04-24T01:48:28.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.732+0000 7f055639d640 1 -- 172.21.15.57:0/1019505176 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f055011f110 con 0x7f0550137c50 2024-04-24T01:48:28.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.732+0000 7f054cff9640 1 -- 172.21.15.57:0/1019505176 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0540005e60 con 0x7f0550137c50 2024-04-24T01:48:28.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.732+0000 7f055639d640 1 -- 172.21.15.57:0/1019505176 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0550122800 con 0x7f0550137c50 2024-04-24T01:48:28.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.732+0000 7f054cff9640 1 -- 172.21.15.57:0/1019505176 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f0540007440 con 0x7f0550137c50 2024-04-24T01:48:28.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.732+0000 7f054cff9640 1 -- 172.21.15.57:0/1019505176 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (crc 0 0 0) 0x7f054000f930 con 0x7f0550137c50 2024-04-24T01:48:28.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.733+0000 7f055639d640 1 -- 172.21.15.57:0/1019505176 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0550069330 con 0x7f0550137c50 2024-04-24T01:48:28.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.735+0000 7f054cff9640 1 -- 172.21.15.57:0/1019505176 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7f054000fb90 con 0x7f0550137c50 2024-04-24T01:48:28.810 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-04-24T01:48:28.809+0000 7f7933031000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-24T01:48:28.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:28.812+0000 7f055639d640 1 -- 172.21.15.57:0/1019505176 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true} v 0) -- 0x7f0550063900 con 0x7f0550137c50 2024-04-24T01:48:28.813 INFO:tasks.ceph.mon.a.smithi057.stderr:2024-04-24T01:48:28.812+0000 7f59e03f4640 -1 WARNING: experimental feature 'crimson' is enabled 2024-04-24T01:48:28.813 INFO:tasks.ceph.mon.a.smithi057.stderr:Please be aware that this feature is experimental, untested, 2024-04-24T01:48:28.813 INFO:tasks.ceph.mon.a.smithi057.stderr:unsupported, and may result in data corruption, data loss, 2024-04-24T01:48:28.813 INFO:tasks.ceph.mon.a.smithi057.stderr:and/or irreparable damage to your cluster. Do not use 2024-04-24T01:48:28.813 INFO:tasks.ceph.mon.a.smithi057.stderr:feature with important data. 2024-04-24T01:48:28.813 INFO:tasks.ceph.mon.a.smithi057.stderr: 2024-04-24T01:48:28.972 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-04-24T01:48:28.972+0000 7f7933031000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-24T01:48:29.026 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-04-24T01:48:29.026+0000 7f7933031000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-24T01:48:29.279 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-04-24T01:48:29.279+0000 7f7933031000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-24T01:48:29.324 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-04-24T01:48:29.323+0000 7f7933031000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-24T01:48:29.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:29.604+0000 7f054cff9640 1 -- 172.21.15.57:0/1019505176 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd set-allow-crimson", "yes_i_really_mean_it": true}]=0 v3) ==== 99+0+0 (crc 0 0 0) 0x7f054000fd30 con 0x7f0550137c50 2024-04-24T01:48:29.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:29.605+0000 7f055639d640 1 -- 172.21.15.57:0/1019505176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0550137c50 msgr2=0x7f055011f670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:29.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:29.605+0000 7f055639d640 1 --2- 172.21.15.57:0/1019505176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0550137c50 0x7f055011f670 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:29.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:29.605+0000 7f055639d640 1 -- 172.21.15.57:0/1019505176 shutdown_connections 2024-04-24T01:48:29.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:29.605+0000 7f055639d640 1 --2- 172.21.15.57:0/1019505176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0550137c50 0x7f055011f670 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:29.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:29.605+0000 7f055639d640 1 -- 172.21.15.57:0/1019505176 >> 172.21.15.57:0/1019505176 conn(0x7f05500a3af0 msgr2=0x7f05500a1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:29.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:29.605+0000 7f055639d640 1 -- 172.21.15.57:0/1019505176 shutdown_connections 2024-04-24T01:48:29.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:29.605+0000 7f055639d640 1 -- 172.21.15.57:0/1019505176 wait complete. 2024-04-24T01:48:29.621 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-24T01:48:29.621 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T01:48:29.621 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-24T01:48:29.649 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T01:48:29.649 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-24T01:48:29.716 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-24T01:48:29.716 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-24T01:48:29.738 DEBUG:teuthology.orchestra.run.smithi084:> set -ex 2024-04-24T01:48:29.738 DEBUG:teuthology.orchestra.run.smithi084:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-24T01:48:29.801 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new fa3dfb45-b86e-45f6-8763-4e2da341521a 0 2024-04-24T01:48:29.947 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.941+0000 7f2c043ee640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:29.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.947+0000 7f2c043ee640 1 Processor -- start 2024-04-24T01:48:29.948 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.947+0000 7f2c043ee640 1 -- start start 2024-04-24T01:48:29.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.948+0000 7f2c043ee640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2bfc113a10 0x7f2bfc113e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:29.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.948+0000 7f2c043ee640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bfc1145e0 con 0x7f2bfc1183e0 2024-04-24T01:48:29.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.948+0000 7f2c043ee640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f2bfc118f20 con 0x7f2bfc113a10 2024-04-24T01:48:29.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.948+0000 7f2c0218a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2bfc113a10 0x7f2bfc113e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:29.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.948+0000 7f2c0218a640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2bfc113a10 0x7f2bfc113e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.84:36738/0 (socket says 172.21.15.84:36738) 2024-04-24T01:48:29.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.948+0000 7f2c0218a640 1 -- 172.21.15.84:0/2675774373 learned_addr learned my addr 172.21.15.84:0/2675774373 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-24T01:48:29.949 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.948+0000 7f2c01989640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2bfc1183e0 0x7f2bfc1187f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.84:42676/0 (socket says 172.21.15.84:42676) 2024-04-24T01:48:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.948+0000 7f2c0218a640 1 -- 172.21.15.84:0/2675774373 >> v1:172.21.15.57:6789/0 conn(0x7f2bfc1183e0 legacy=0x7f2bfc1187f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.948+0000 7f2c0218a640 1 -- 172.21.15.84:0/2675774373 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bfc119090 con 0x7f2bfc113a10 2024-04-24T01:48:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.949+0000 7f2c0218a640 1 --2- 172.21.15.84:0/2675774373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bfc113a10 0x7f2bfc113e20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5482360d0f8aac6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.949+0000 7f2c01188640 1 -- 172.21.15.84:0/2675774373 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2bec009e50 con 0x7f2bfc113a10 2024-04-24T01:48:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.949+0000 7f2c01188640 1 -- 172.21.15.84:0/2675774373 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2bec00e230 con 0x7f2bfc113a10 2024-04-24T01:48:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.949+0000 7f2c01188640 1 -- 172.21.15.84:0/2675774373 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2bec00e4d0 con 0x7f2bfc113a10 2024-04-24T01:48:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.950+0000 7f2c043ee640 1 -- 172.21.15.84:0/2675774373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bfc113a10 msgr2=0x7f2bfc113e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.950+0000 7f2c043ee640 1 --2- 172.21.15.84:0/2675774373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bfc113a10 0x7f2bfc113e20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:29.951 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.950+0000 7f2c043ee640 1 -- 172.21.15.84:0/2675774373 shutdown_connections 2024-04-24T01:48:29.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.950+0000 7f2c043ee640 1 --2- 172.21.15.84:0/2675774373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bfc113a10 0x7f2bfc113e20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:29.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.950+0000 7f2c043ee640 1 -- 172.21.15.84:0/2675774373 >> 172.21.15.84:0/2675774373 conn(0x7f2bfc06ef30 msgr2=0x7f2bfc111d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:29.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.950+0000 7f2c043ee640 1 -- 172.21.15.84:0/2675774373 shutdown_connections 2024-04-24T01:48:29.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.950+0000 7f2c043ee640 1 -- 172.21.15.84:0/2675774373 wait complete. 2024-04-24T01:48:29.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.950+0000 7f2c043ee640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:29.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.951+0000 7f2c043ee640 1 Processor -- start 2024-04-24T01:48:29.952 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.951+0000 7f2c043ee640 1 -- start start 2024-04-24T01:48:29.953 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.951+0000 7f2c043ee640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bfc113a10 0x7f2bfc1ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.951+0000 7f2c043ee640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f2bfc1ae770 con 0x7f2bfc113a10 2024-04-24T01:48:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.951+0000 7f2c0218a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bfc113a10 0x7f2bfc1ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.951+0000 7f2c0218a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bfc113a10 0x7f2bfc1ae1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.84:36754/0 (socket says 172.21.15.84:36754) 2024-04-24T01:48:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.951+0000 7f2c0218a640 1 -- 172.21.15.84:0/1928006920 learned_addr learned my addr 172.21.15.84:0/1928006920 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-24T01:48:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.952+0000 7f2c0218a640 1 -- 172.21.15.84:0/1928006920 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bfc1ae8b0 con 0x7f2bfc113a10 2024-04-24T01:48:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.952+0000 7f2c0218a640 1 --2- 172.21.15.84:0/1928006920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bfc113a10 0x7f2bfc1ae1a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.952+0000 7f2bf2ffd640 1 -- 172.21.15.84:0/1928006920 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2bec00ee80 con 0x7f2bfc113a10 2024-04-24T01:48:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.952+0000 7f2bf2ffd640 1 -- 172.21.15.84:0/1928006920 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2bec015420 con 0x7f2bfc113a10 2024-04-24T01:48:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.952+0000 7f2c043ee640 1 -- 172.21.15.84:0/1928006920 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bfc1aeaa0 con 0x7f2bfc113a10 2024-04-24T01:48:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.952+0000 7f2bf2ffd640 1 -- 172.21.15.84:0/1928006920 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2bec0156c0 con 0x7f2bfc113a10 2024-04-24T01:48:29.954 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.952+0000 7f2c043ee640 1 -- 172.21.15.84:0/1928006920 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bfc1a8500 con 0x7f2bfc113a10 2024-04-24T01:48:29.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.952+0000 7f2bf2ffd640 1 -- 172.21.15.84:0/1928006920 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f2bec015c50 con 0x7f2bfc113a10 2024-04-24T01:48:29.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.952+0000 7f2bf2ffd640 1 -- 172.21.15.84:0/1928006920 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 747+0+0 (crc 0 0 0) 0x7f2bec0116d0 con 0x7f2bfc113a10 2024-04-24T01:48:29.955 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.953+0000 7f2c043ee640 1 -- 172.21.15.84:0/1928006920 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bfc1aec90 con 0x7f2bfc113a10 2024-04-24T01:48:29.956 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:29.956+0000 7f2bf2ffd640 1 -- 172.21.15.84:0/1928006920 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7f2bec011890 con 0x7f2bfc113a10 2024-04-24T01:48:30.029 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.028+0000 7f2c043ee640 1 -- 172.21.15.84:0/1928006920 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fa3dfb45-b86e-45f6-8763-4e2da341521a", "id": 0} v 0) -- 0x7f2bfc0008d0 con 0x7f2bfc113a10 2024-04-24T01:48:30.032 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.032+0000 7f2bf2ffd640 1 -- 172.21.15.84:0/1928006920 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fa3dfb45-b86e-45f6-8763-4e2da341521a", "id": 0}]=0 v4) ==== 112+0+2 (crc 0 0 0) 0x7f2bec011b80 con 0x7f2bfc113a10 2024-04-24T01:48:30.033 INFO:teuthology.orchestra.run.smithi084.stdout:0 2024-04-24T01:48:30.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.033+0000 7f2c043ee640 1 -- 172.21.15.84:0/1928006920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bfc113a10 msgr2=0x7f2bfc1ae1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:30.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.033+0000 7f2c043ee640 1 --2- 172.21.15.84:0/1928006920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bfc113a10 0x7f2bfc1ae1a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:30.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.033+0000 7f2c043ee640 1 -- 172.21.15.84:0/1928006920 shutdown_connections 2024-04-24T01:48:30.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.033+0000 7f2c043ee640 1 --2- 172.21.15.84:0/1928006920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2bfc113a10 0x7f2bfc1ae1a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:30.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.033+0000 7f2c043ee640 1 -- 172.21.15.84:0/1928006920 >> 172.21.15.84:0/1928006920 conn(0x7f2bfc06ef30 msgr2=0x7f2bfc111e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:30.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.033+0000 7f2c043ee640 1 -- 172.21.15.84:0/1928006920 shutdown_connections 2024-04-24T01:48:30.034 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.033+0000 7f2c043ee640 1 -- 172.21.15.84:0/1928006920 wait complete. 2024-04-24T01:48:30.044 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new 983d404f-e45f-476b-aba9-7295e360b0c5 1 2024-04-24T01:48:30.049 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-04-24T01:48:30.049+0000 7f7933031000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-24T01:48:30.143 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-04-24T01:48:30.142+0000 7f7933031000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-24T01:48:30.150 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.143+0000 7f447826d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:30.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.150+0000 7f447826d640 1 Processor -- start 2024-04-24T01:48:30.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.150+0000 7f447826d640 1 -- start start 2024-04-24T01:48:30.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.150+0000 7f447826d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4470119760 0x7f447011bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:30.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.150+0000 7f447826d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4470112530 con 0x7f4470111890 2024-04-24T01:48:30.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.150+0000 7f447826d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f447011d0d0 con 0x7f4470119760 2024-04-24T01:48:30.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.150+0000 7f4475808640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4470119760 0x7f447011bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:30.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.151+0000 7f4475808640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4470119760 0x7f447011bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.84:36762/0 (socket says 172.21.15.84:36762) 2024-04-24T01:48:30.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.151+0000 7f4475808640 1 -- 172.21.15.84:0/518524548 learned_addr learned my addr 172.21.15.84:0/518524548 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-24T01:48:30.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.151+0000 7f4475808640 1 -- 172.21.15.84:0/518524548 >> v1:172.21.15.57:6789/0 conn(0x7f4470111890 legacy=0x7f4470111ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:30.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.151+0000 7f4475808640 1 -- 172.21.15.84:0/518524548 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f447011d240 con 0x7f4470119760 2024-04-24T01:48:30.152 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.151+0000 7f4475808640 1 --2- 172.21.15.84:0/518524548 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4470119760 0x7f447011bb80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec0ddd73d45823cd server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:30.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.151+0000 7f4475007640 1 -- 172.21.15.84:0/518524548 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4460009e50 con 0x7f4470119760 2024-04-24T01:48:30.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.151+0000 7f4475007640 1 -- 172.21.15.84:0/518524548 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f446000e230 con 0x7f4470119760 2024-04-24T01:48:30.153 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.151+0000 7f4475007640 1 -- 172.21.15.84:0/518524548 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f446000e4d0 con 0x7f4470119760 2024-04-24T01:48:30.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.152+0000 7f447826d640 1 -- 172.21.15.84:0/518524548 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4470119760 msgr2=0x7f447011bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:30.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.152+0000 7f447826d640 1 --2- 172.21.15.84:0/518524548 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4470119760 0x7f447011bb80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:30.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.152+0000 7f447826d640 1 -- 172.21.15.84:0/518524548 shutdown_connections 2024-04-24T01:48:30.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.152+0000 7f447826d640 1 --2- 172.21.15.84:0/518524548 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4470119760 0x7f447011bb80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:30.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.152+0000 7f447826d640 1 -- 172.21.15.84:0/518524548 >> 172.21.15.84:0/518524548 conn(0x7f447006fc70 msgr2=0x7f4470072090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:30.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.152+0000 7f447826d640 1 -- 172.21.15.84:0/518524548 shutdown_connections 2024-04-24T01:48:30.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.152+0000 7f447826d640 1 -- 172.21.15.84:0/518524548 wait complete. 2024-04-24T01:48:30.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.152+0000 7f447826d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:30.156 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.153+0000 7f447826d640 1 Processor -- start 2024-04-24T01:48:30.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.153+0000 7f447826d640 1 -- start start 2024-04-24T01:48:30.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.153+0000 7f447826d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4470111890 0x7f44701a7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:30.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.153+0000 7f447826d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f44701a7850 con 0x7f4470111890 2024-04-24T01:48:30.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.154+0000 7f4476009640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4470111890 0x7f44701a7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:30.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.154+0000 7f4476009640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4470111890 0x7f44701a7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.84:36778/0 (socket says 172.21.15.84:36778) 2024-04-24T01:48:30.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.154+0000 7f4476009640 1 -- 172.21.15.84:0/567710193 learned_addr learned my addr 172.21.15.84:0/567710193 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-24T01:48:30.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.154+0000 7f4476009640 1 -- 172.21.15.84:0/567710193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44701a7990 con 0x7f4470111890 2024-04-24T01:48:30.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.154+0000 7f4476009640 1 --2- 172.21.15.84:0/567710193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4470111890 0x7f44701a7310 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:30.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.154+0000 7f4466ffd640 1 -- 172.21.15.84:0/567710193 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f446c00c870 con 0x7f4470111890 2024-04-24T01:48:30.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.154+0000 7f4466ffd640 1 -- 172.21.15.84:0/567710193 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f446c00c9d0 con 0x7f4470111890 2024-04-24T01:48:30.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.154+0000 7f447826d640 1 -- 172.21.15.84:0/567710193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44701a7be0 con 0x7f4470111890 2024-04-24T01:48:30.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.154+0000 7f4466ffd640 1 -- 172.21.15.84:0/567710193 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f446c00cc70 con 0x7f4470111890 2024-04-24T01:48:30.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.154+0000 7f447826d640 1 -- 172.21.15.84:0/567710193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44701a8030 con 0x7f4470111890 2024-04-24T01:48:30.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.155+0000 7f4466ffd640 1 -- 172.21.15.84:0/567710193 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f446c0116a0 con 0x7f4470111890 2024-04-24T01:48:30.157 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.155+0000 7f4466ffd640 1 -- 172.21.15.84:0/567710193 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 862+0+0 (crc 0 0 0) 0x7f446c010d90 con 0x7f4470111890 2024-04-24T01:48:30.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.155+0000 7f447826d640 1 -- 172.21.15.84:0/567710193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4470063900 con 0x7f4470111890 2024-04-24T01:48:30.158 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.158+0000 7f4466ffd640 1 -- 172.21.15.84:0/567710193 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7f446c011b80 con 0x7f4470111890 2024-04-24T01:48:30.188 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-04-24T01:48:30.187+0000 7f7933031000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-24T01:48:30.231 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.230+0000 7f447826d640 1 -- 172.21.15.84:0/567710193 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd new", "uuid": "983d404f-e45f-476b-aba9-7295e360b0c5", "id": 1} v 0) -- 0x7f4470119760 con 0x7f4470111890 2024-04-24T01:48:30.234 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.234+0000 7f4466ffd640 1 -- 172.21.15.84:0/567710193 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "983d404f-e45f-476b-aba9-7295e360b0c5", "id": 1}]=0 v5) ==== 112+0+2 (crc 0 0 0) 0x7f446c011da0 con 0x7f4470111890 2024-04-24T01:48:30.235 INFO:teuthology.orchestra.run.smithi084.stdout:1 2024-04-24T01:48:30.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.235+0000 7f447826d640 1 -- 172.21.15.84:0/567710193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4470111890 msgr2=0x7f44701a7310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:30.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.235+0000 7f447826d640 1 --2- 172.21.15.84:0/567710193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4470111890 0x7f44701a7310 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:30.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.235+0000 7f447826d640 1 -- 172.21.15.84:0/567710193 shutdown_connections 2024-04-24T01:48:30.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.235+0000 7f447826d640 1 --2- 172.21.15.84:0/567710193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4470111890 0x7f44701a7310 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:30.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.235+0000 7f447826d640 1 -- 172.21.15.84:0/567710193 >> 172.21.15.84:0/567710193 conn(0x7f447006fc70 msgr2=0x7f4470071da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:30.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.235+0000 7f447826d640 1 -- 172.21.15.84:0/567710193 shutdown_connections 2024-04-24T01:48:30.236 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.235+0000 7f447826d640 1 -- 172.21.15.84:0/567710193 wait complete. 2024-04-24T01:48:30.245 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new 7c919704-afb7-4a77-afb5-0480a2a172dd 2 2024-04-24T01:48:30.362 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-04-24T01:48:30.361+0000 7f7933031000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-24T01:48:30.391 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.384+0000 7f4c7986d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:30.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.391+0000 7f4c7986d640 1 Processor -- start 2024-04-24T01:48:30.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.391+0000 7f4c7986d640 1 -- start start 2024-04-24T01:48:30.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.391+0000 7f4c7986d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4c74118890 0x7f4c74118ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:30.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.391+0000 7f4c7986d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c741193b0 con 0x7f4c741138a0 2024-04-24T01:48:30.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.391+0000 7f4c7986d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f4c74050000 con 0x7f4c74118890 2024-04-24T01:48:30.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.392+0000 7f4c72ffd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4c74118890 0x7f4c74118ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:30.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.392+0000 7f4c72ffd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4c74118890 0x7f4c74118ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.84:36794/0 (socket says 172.21.15.84:36794) 2024-04-24T01:48:30.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.392+0000 7f4c72ffd640 1 -- 172.21.15.84:0/2780672294 learned_addr learned my addr 172.21.15.84:0/2780672294 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-24T01:48:30.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.392+0000 7f4c72ffd640 1 -- 172.21.15.84:0/2780672294 >> v1:172.21.15.57:6789/0 conn(0x7f4c741138a0 legacy=0x7f4c74113cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:30.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.392+0000 7f4c72ffd640 1 -- 172.21.15.84:0/2780672294 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c741143f0 con 0x7f4c74118890 2024-04-24T01:48:30.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.392+0000 7f4c72ffd640 1 --2- 172.21.15.84:0/2780672294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c74118890 0x7f4c74118ca0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba2c10925d3b530 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:30.393 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.392+0000 7f4c71ffb640 1 -- 172.21.15.84:0/2780672294 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4c68009e50 con 0x7f4c74118890 2024-04-24T01:48:30.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.392+0000 7f4c71ffb640 1 -- 172.21.15.84:0/2780672294 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4c6800e230 con 0x7f4c74118890 2024-04-24T01:48:30.394 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.392+0000 7f4c71ffb640 1 -- 172.21.15.84:0/2780672294 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4c6800e4d0 con 0x7f4c74118890 2024-04-24T01:48:30.395 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.393+0000 7f4c7986d640 1 -- 172.21.15.84:0/2780672294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c74118890 msgr2=0x7f4c74118ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:30.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.393+0000 7f4c7986d640 1 --2- 172.21.15.84:0/2780672294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c74118890 0x7f4c74118ca0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:30.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.393+0000 7f4c7986d640 1 -- 172.21.15.84:0/2780672294 shutdown_connections 2024-04-24T01:48:30.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.393+0000 7f4c7986d640 1 --2- 172.21.15.84:0/2780672294 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c74118890 0x7f4c74118ca0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:30.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.393+0000 7f4c7986d640 1 -- 172.21.15.84:0/2780672294 >> 172.21.15.84:0/2780672294 conn(0x7f4c7406f070 msgr2=0x7f4c74111d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:30.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.393+0000 7f4c7986d640 1 -- 172.21.15.84:0/2780672294 shutdown_connections 2024-04-24T01:48:30.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.393+0000 7f4c7986d640 1 -- 172.21.15.84:0/2780672294 wait complete. 2024-04-24T01:48:30.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.394+0000 7f4c7986d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:30.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.394+0000 7f4c7986d640 1 Processor -- start 2024-04-24T01:48:30.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.394+0000 7f4c7986d640 1 -- start start 2024-04-24T01:48:30.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.395+0000 7f4c7986d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c741138a0 0x7f4c741ae1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:30.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.395+0000 7f4c7986d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f4c741ae790 con 0x7f4c741138a0 2024-04-24T01:48:30.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.395+0000 7f4c72ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c741138a0 0x7f4c741ae1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:30.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.395+0000 7f4c72ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c741138a0 0x7f4c741ae1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.84:36800/0 (socket says 172.21.15.84:36800) 2024-04-24T01:48:30.396 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.395+0000 7f4c72ffd640 1 -- 172.21.15.84:0/2395435369 learned_addr learned my addr 172.21.15.84:0/2395435369 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-24T01:48:30.397 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.395+0000 7f4c72ffd640 1 -- 172.21.15.84:0/2395435369 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c741ae8d0 con 0x7f4c741138a0 2024-04-24T01:48:30.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.396+0000 7f4c72ffd640 1 --2- 172.21.15.84:0/2395435369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c741138a0 0x7f4c741ae1c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:30.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.396+0000 7f4c5bfff640 1 -- 172.21.15.84:0/2395435369 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4c6800eea0 con 0x7f4c741138a0 2024-04-24T01:48:30.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.396+0000 7f4c5bfff640 1 -- 172.21.15.84:0/2395435369 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4c68015420 con 0x7f4c741138a0 2024-04-24T01:48:30.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.396+0000 7f4c5bfff640 1 -- 172.21.15.84:0/2395435369 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4c680156c0 con 0x7f4c741138a0 2024-04-24T01:48:30.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.396+0000 7f4c7986d640 1 -- 172.21.15.84:0/2395435369 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c741aeac0 con 0x7f4c741138a0 2024-04-24T01:48:30.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.396+0000 7f4c7986d640 1 -- 172.21.15.84:0/2395435369 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c741a8520 con 0x7f4c741138a0 2024-04-24T01:48:30.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.396+0000 7f4c5bfff640 1 -- 172.21.15.84:0/2395435369 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f4c68015c50 con 0x7f4c741138a0 2024-04-24T01:48:30.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.396+0000 7f4c5bfff640 1 -- 172.21.15.84:0/2395435369 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 977+0+0 (crc 0 0 0) 0x7f4c680117c0 con 0x7f4c741138a0 2024-04-24T01:48:30.398 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.397+0000 7f4c7986d640 1 -- 172.21.15.84:0/2395435369 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c741aecb0 con 0x7f4c741138a0 2024-04-24T01:48:30.399 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.399+0000 7f4c5bfff640 1 -- 172.21.15.84:0/2395435369 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7f4c68011380 con 0x7f4c741138a0 2024-04-24T01:48:30.421 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-04-24T01:48:30.421+0000 7f7933031000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-24T01:48:30.472 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.471+0000 7f4c7986d640 1 -- 172.21.15.84:0/2395435369 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7c919704-afb7-4a77-afb5-0480a2a172dd", "id": 2} v 0) -- 0x7f4c74118ad0 con 0x7f4c741138a0 2024-04-24T01:48:30.473 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.473+0000 7f4c5bfff640 1 -- 172.21.15.84:0/2395435369 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7c919704-afb7-4a77-afb5-0480a2a172dd", "id": 2}]=0 v6) ==== 112+0+2 (crc 0 0 0) 0x7f4c680115a0 con 0x7f4c741138a0 2024-04-24T01:48:30.473 INFO:teuthology.orchestra.run.smithi084.stdout:2 2024-04-24T01:48:30.474 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.474+0000 7f4c7986d640 1 -- 172.21.15.84:0/2395435369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c741138a0 msgr2=0x7f4c741ae1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:30.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.474+0000 7f4c7986d640 1 --2- 172.21.15.84:0/2395435369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c741138a0 0x7f4c741ae1c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:30.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.474+0000 7f4c7986d640 1 -- 172.21.15.84:0/2395435369 shutdown_connections 2024-04-24T01:48:30.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.474+0000 7f4c7986d640 1 --2- 172.21.15.84:0/2395435369 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c741138a0 0x7f4c741ae1c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:30.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.474+0000 7f4c7986d640 1 -- 172.21.15.84:0/2395435369 >> 172.21.15.84:0/2395435369 conn(0x7f4c7406f070 msgr2=0x7f4c74112140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:30.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.474+0000 7f4c7986d640 1 -- 172.21.15.84:0/2395435369 shutdown_connections 2024-04-24T01:48:30.475 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.474+0000 7f4c7986d640 1 -- 172.21.15.84:0/2395435369 wait complete. 2024-04-24T01:48:30.475 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-04-24T01:48:30.475+0000 7f7933031000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-24T01:48:30.484 DEBUG:teuthology.orchestra.run.smithi084:> sudo ceph --cluster ceph osd new 8f156a3e-e3eb-4b10-85b5-0b3c99a5057e 3 2024-04-24T01:48:30.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.583+0000 7f076019d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:30.589 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.589+0000 7f076019d640 1 Processor -- start 2024-04-24T01:48:30.590 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.589+0000 7f076019d640 1 -- start start 2024-04-24T01:48:30.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.589+0000 7f076019d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0758113a10 0x7f0758113e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:30.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.590+0000 7f076019d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07581145e0 con 0x7f07581183e0 2024-04-24T01:48:30.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.590+0000 7f076019d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f0758118f20 con 0x7f0758113a10 2024-04-24T01:48:30.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.590+0000 7f075df39640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0758113a10 0x7f0758113e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:30.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.590+0000 7f075df39640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0758113a10 0x7f0758113e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.84:36808/0 (socket says 172.21.15.84:36808) 2024-04-24T01:48:30.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.590+0000 7f075df39640 1 -- 172.21.15.84:0/1573034418 learned_addr learned my addr 172.21.15.84:0/1573034418 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-24T01:48:30.591 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.590+0000 7f075df39640 1 -- 172.21.15.84:0/1573034418 >> v1:172.21.15.57:6789/0 conn(0x7f07581183e0 legacy=0x7f07581187f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:30.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.590+0000 7f075df39640 1 -- 172.21.15.84:0/1573034418 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0758119090 con 0x7f0758113a10 2024-04-24T01:48:30.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.590+0000 7f075df39640 1 --2- 172.21.15.84:0/1573034418 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0758113a10 0x7f0758113e20 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7e7d6900bfcaea server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:30.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.590+0000 7f075cf37640 1 -- 172.21.15.84:0/1573034418 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0748009e50 con 0x7f0758113a10 2024-04-24T01:48:30.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.591+0000 7f075cf37640 1 -- 172.21.15.84:0/1573034418 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f074800e230 con 0x7f0758113a10 2024-04-24T01:48:30.592 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.591+0000 7f075cf37640 1 -- 172.21.15.84:0/1573034418 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f074800e4d0 con 0x7f0758113a10 2024-04-24T01:48:30.593 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.591+0000 7f076019d640 1 -- 172.21.15.84:0/1573034418 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0758113a10 msgr2=0x7f0758113e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:30.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.591+0000 7f076019d640 1 --2- 172.21.15.84:0/1573034418 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0758113a10 0x7f0758113e20 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:30.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.591+0000 7f076019d640 1 -- 172.21.15.84:0/1573034418 shutdown_connections 2024-04-24T01:48:30.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.591+0000 7f076019d640 1 --2- 172.21.15.84:0/1573034418 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0758113a10 0x7f0758113e20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:30.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.591+0000 7f076019d640 1 -- 172.21.15.84:0/1573034418 >> 172.21.15.84:0/1573034418 conn(0x7f075806ef30 msgr2=0x7f0758111d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:30.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.591+0000 7f076019d640 1 -- 172.21.15.84:0/1573034418 shutdown_connections 2024-04-24T01:48:30.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.591+0000 7f076019d640 1 -- 172.21.15.84:0/1573034418 wait complete. 2024-04-24T01:48:30.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.592+0000 7f076019d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:30.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.592+0000 7f076019d640 1 Processor -- start 2024-04-24T01:48:30.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.592+0000 7f076019d640 1 -- start start 2024-04-24T01:48:30.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.592+0000 7f076019d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0758113a10 0x7f07581ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:30.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.592+0000 7f076019d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f07581ae770 con 0x7f0758113a10 2024-04-24T01:48:30.594 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.593+0000 7f075df39640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0758113a10 0x7f07581ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:30.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.593+0000 7f075df39640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0758113a10 0x7f07581ae1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.84:36814/0 (socket says 172.21.15.84:36814) 2024-04-24T01:48:30.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.593+0000 7f075df39640 1 -- 172.21.15.84:0/4230436728 learned_addr learned my addr 172.21.15.84:0/4230436728 (peer_addr_for_me v2:172.21.15.84:0/0) 2024-04-24T01:48:30.595 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.593+0000 7f075df39640 1 -- 172.21.15.84:0/4230436728 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07581ae8b0 con 0x7f0758113a10 2024-04-24T01:48:30.595 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-04-24T01:48:30.593+0000 7f7933031000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-24T01:48:30.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.593+0000 7f075df39640 1 --2- 172.21.15.84:0/4230436728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0758113a10 0x7f07581ae1a0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:30.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.593+0000 7f074e7fc640 1 -- 172.21.15.84:0/4230436728 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f074800eea0 con 0x7f0758113a10 2024-04-24T01:48:30.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.593+0000 7f074e7fc640 1 -- 172.21.15.84:0/4230436728 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0748015420 con 0x7f0758113a10 2024-04-24T01:48:30.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.593+0000 7f076019d640 1 -- 172.21.15.84:0/4230436728 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07581aeaa0 con 0x7f0758113a10 2024-04-24T01:48:30.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.594+0000 7f074e7fc640 1 -- 172.21.15.84:0/4230436728 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f07480156c0 con 0x7f0758113a10 2024-04-24T01:48:30.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.594+0000 7f076019d640 1 -- 172.21.15.84:0/4230436728 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07581a8500 con 0x7f0758113a10 2024-04-24T01:48:30.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.594+0000 7f074e7fc640 1 -- 172.21.15.84:0/4230436728 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f0748015c50 con 0x7f0758113a10 2024-04-24T01:48:30.596 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.594+0000 7f074e7fc640 1 -- 172.21.15.84:0/4230436728 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1092+0+0 (crc 0 0 0) 0x7f0748011830 con 0x7f0758113a10 2024-04-24T01:48:30.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.595+0000 7f076019d640 1 -- 172.21.15.84:0/4230436728 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07581aec90 con 0x7f0758113a10 2024-04-24T01:48:30.597 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.597+0000 7f074e7fc640 1 -- 172.21.15.84:0/4230436728 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7f0748011380 con 0x7f0758113a10 2024-04-24T01:48:30.669 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.669+0000 7f076019d640 1 -- 172.21.15.84:0/4230436728 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8f156a3e-e3eb-4b10-85b5-0b3c99a5057e", "id": 3} v 0) -- 0x7f07580008d0 con 0x7f0758113a10 2024-04-24T01:48:30.674 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.670+0000 7f074e7fc640 1 -- 172.21.15.84:0/4230436728 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8f156a3e-e3eb-4b10-85b5-0b3c99a5057e", "id": 3}]=0 v7) ==== 112+0+2 (crc 0 0 0) 0x7f0748011670 con 0x7f0758113a10 2024-04-24T01:48:30.675 INFO:teuthology.orchestra.run.smithi084.stdout:3 2024-04-24T01:48:30.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.671+0000 7f076019d640 1 -- 172.21.15.84:0/4230436728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0758113a10 msgr2=0x7f07581ae1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:30.675 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.671+0000 7f076019d640 1 --2- 172.21.15.84:0/4230436728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0758113a10 0x7f07581ae1a0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:30.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.671+0000 7f076019d640 1 -- 172.21.15.84:0/4230436728 shutdown_connections 2024-04-24T01:48:30.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.671+0000 7f076019d640 1 --2- 172.21.15.84:0/4230436728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0758113a10 0x7f07581ae1a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:30.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.671+0000 7f076019d640 1 -- 172.21.15.84:0/4230436728 >> 172.21.15.84:0/4230436728 conn(0x7f075806ef30 msgr2=0x7f0758111e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:30.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.671+0000 7f076019d640 1 -- 172.21.15.84:0/4230436728 shutdown_connections 2024-04-24T01:48:30.676 INFO:teuthology.orchestra.run.smithi084.stderr:2024-04-24T01:48:30.671+0000 7f076019d640 1 -- 172.21.15.84:0/4230436728 wait complete. 2024-04-24T01:48:30.682 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.0.log 2024-04-24T01:48:30.717 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-24T01:48:30.717 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2>> /var/log/ceph/ceph-osd.0.log 2024-04-24T01:48:30.760 INFO:tasks.ceph.osd.0:Started 2024-04-24T01:48:30.761 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.1.log 2024-04-24T01:48:30.792 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-24T01:48:30.793 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2>> /var/log/ceph/ceph-osd.1.log 2024-04-24T01:48:30.836 INFO:tasks.ceph.osd.1:Started 2024-04-24T01:48:30.836 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.2.log 2024-04-24T01:48:30.864 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-24T01:48:30.864 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2>> /var/log/ceph/ceph-osd.2.log 2024-04-24T01:48:30.906 INFO:tasks.ceph.osd.2:Started 2024-04-24T01:48:30.906 DEBUG:teuthology.orchestra.run.smithi084:> sudo install -b -o ubuntu -g ubuntu /dev/null /var/log/ceph/ceph-osd.3.log 2024-04-24T01:48:30.934 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-24T01:48:30.934 DEBUG:teuthology.orchestra.run.smithi084:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2>> /var/log/ceph/ceph-osd.3.log 2024-04-24T01:48:30.977 INFO:tasks.ceph.osd.3:Started 2024-04-24T01:48:30.977 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T01:48:30.989 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-04-24T01:48:30.989+0000 7f7933031000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-24T01:48:31.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.089+0000 7f5caecad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:31.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.095+0000 7f5caecad640 1 Processor -- start 2024-04-24T01:48:31.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.095+0000 7f5caecad640 1 -- start start 2024-04-24T01:48:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.096+0000 7f5caecad640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ca809f630 0x7f5ca80a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.096+0000 7f5caecad640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ca809ddd0 con 0x7f5ca80a0c30 2024-04-24T01:48:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.096+0000 7f5caecad640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f5ca809fa40 con 0x7f5ca809f630 2024-04-24T01:48:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.097+0000 7f5caca49640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ca809f630 0x7f5ca80a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.097+0000 7f5ca7fff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5ca80a0c30 0x7f5ca8134940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46628/0 (socket says 172.21.15.57:46628) 2024-04-24T01:48:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.097+0000 7f5ca7fff640 1 -- 172.21.15.57:0/2107449202 learned_addr learned my addr 172.21.15.57:0/2107449202 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T01:48:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.097+0000 7f5caca49640 1 -- 172.21.15.57:0/2107449202 >> v1:172.21.15.57:6789/0 conn(0x7f5ca80a0c30 legacy=0x7f5ca8134940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.097+0000 7f5caca49640 1 -- 172.21.15.57:0/2107449202 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca809f100 con 0x7f5ca809f630 2024-04-24T01:48:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.097+0000 7f5ca77fe640 1 -- 172.21.15.57:0/2107449202 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 562669939 0 0) 0x7f5ca809ddd0 con 0x7f5ca80a0c30 2024-04-24T01:48:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.097+0000 7f5caca49640 1 --2- 172.21.15.57:0/2107449202 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ca809f630 0x7f5ca80a06f0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e934884e4af311e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.097+0000 7f5ca77fe640 1 -- 172.21.15.57:0/2107449202 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5c98009d90 con 0x7f5ca809f630 2024-04-24T01:48:31.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.097+0000 7f5ca77fe640 1 -- 172.21.15.57:0/2107449202 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5c9800e230 con 0x7f5ca809f630 2024-04-24T01:48:31.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.097+0000 7f5ca77fe640 1 -- 172.21.15.57:0/2107449202 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5c9800e4d0 con 0x7f5ca809f630 2024-04-24T01:48:31.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.098+0000 7f5caecad640 1 -- 172.21.15.57:0/2107449202 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ca809f630 msgr2=0x7f5ca80a06f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:31.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.098+0000 7f5caecad640 1 --2- 172.21.15.57:0/2107449202 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ca809f630 0x7f5ca80a06f0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:31.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.098+0000 7f5caecad640 1 -- 172.21.15.57:0/2107449202 shutdown_connections 2024-04-24T01:48:31.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.098+0000 7f5caecad640 1 --2- 172.21.15.57:0/2107449202 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ca809f630 0x7f5ca80a06f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:31.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.098+0000 7f5caecad640 1 -- 172.21.15.57:0/2107449202 >> 172.21.15.57:0/2107449202 conn(0x7f5ca80a3950 msgr2=0x7f5ca80a3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:31.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.098+0000 7f5caecad640 1 -- 172.21.15.57:0/2107449202 shutdown_connections 2024-04-24T01:48:31.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.098+0000 7f5caecad640 1 -- 172.21.15.57:0/2107449202 wait complete. 2024-04-24T01:48:31.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.099+0000 7f5caecad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:31.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.100+0000 7f5caecad640 1 Processor -- start 2024-04-24T01:48:31.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.100+0000 7f5caecad640 1 -- start start 2024-04-24T01:48:31.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.102+0000 7f5caecad640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ca809f630 0x7f5ca811dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:31.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.102+0000 7f5caecad640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca811f510 con 0x7f5ca809f630 2024-04-24T01:48:31.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.102+0000 7f5caca49640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ca809f630 0x7f5ca811dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:31.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.102+0000 7f5caca49640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ca809f630 0x7f5ca811dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40724/0 (socket says 172.21.15.57:40724) 2024-04-24T01:48:31.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.102+0000 7f5caca49640 1 -- 172.21.15.57:0/2190561527 learned_addr learned my addr 172.21.15.57:0/2190561527 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T01:48:31.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.102+0000 7f5caca49640 1 -- 172.21.15.57:0/2190561527 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca8121610 con 0x7f5ca809f630 2024-04-24T01:48:31.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.103+0000 7f5caca49640 1 --2- 172.21.15.57:0/2190561527 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ca809f630 0x7f5ca811dff0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:31.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.103+0000 7f5ca57fa640 1 -- 172.21.15.57:0/2190561527 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5c98014620 con 0x7f5ca809f630 2024-04-24T01:48:31.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.103+0000 7f5ca57fa640 1 -- 172.21.15.57:0/2190561527 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5c98014780 con 0x7f5ca809f630 2024-04-24T01:48:31.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.103+0000 7f5caecad640 1 -- 172.21.15.57:0/2190561527 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca81207a0 con 0x7f5ca809f630 2024-04-24T01:48:31.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.103+0000 7f5ca57fa640 1 -- 172.21.15.57:0/2190561527 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5c98014a20 con 0x7f5ca809f630 2024-04-24T01:48:31.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.103+0000 7f5caecad640 1 -- 172.21.15.57:0/2190561527 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca8122000 con 0x7f5ca809f630 2024-04-24T01:48:31.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.103+0000 7f5ca57fa640 1 -- 172.21.15.57:0/2190561527 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f5c98013400 con 0x7f5ca809f630 2024-04-24T01:48:31.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.103+0000 7f5ca57fa640 1 -- 172.21.15.57:0/2190561527 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1207+0+0 (crc 0 0 0) 0x7f5c98019040 con 0x7f5ca809f630 2024-04-24T01:48:31.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.104+0000 7f5caecad640 1 -- 172.21.15.57:0/2190561527 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ca809fd20 con 0x7f5ca809f630 2024-04-24T01:48:31.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.106+0000 7f5ca57fa640 1 -- 172.21.15.57:0/2190561527 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7f5c98011c60 con 0x7f5ca809f630 2024-04-24T01:48:31.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.168+0000 7f5caecad640 1 -- 172.21.15.57:0/2190561527 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5ca80a0020 con 0x7f5ca809f630 2024-04-24T01:48:31.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.169+0000 7f5ca57fa640 1 -- 172.21.15.57:0/2190561527 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4152 (crc 0 0 0) 0x7f5c980116a0 con 0x7f5ca809f630 2024-04-24T01:48:31.170 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:31.170 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":7,"fsid":"2097e8c9-9d10-45f4-a30f-1b3cf153e5e6","created":"2024-04-24T01:48:28.514903+0000","modified":"2024-04-24T01:48:30.670792+0000","last_up_change":"0.000000","last_in_change":"2024-04-24T01:48:30.670792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"fa3dfb45-b86e-45f6-8763-4e2da341521a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"983d404f-e45f-476b-aba9-7295e360b0c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7c919704-afb7-4a77-afb5-0480a2a172dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8f156a3e-e3eb-4b10-85b5-0b3c99a5057e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T01:48:31.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.170+0000 7f5caecad640 1 -- 172.21.15.57:0/2190561527 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ca809f630 msgr2=0x7f5ca811dff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:31.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.170+0000 7f5caecad640 1 --2- 172.21.15.57:0/2190561527 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ca809f630 0x7f5ca811dff0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:31.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.170+0000 7f5caecad640 1 -- 172.21.15.57:0/2190561527 shutdown_connections 2024-04-24T01:48:31.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.170+0000 7f5caecad640 1 --2- 172.21.15.57:0/2190561527 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ca809f630 0x7f5ca811dff0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:31.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.170+0000 7f5caecad640 1 -- 172.21.15.57:0/2190561527 >> 172.21.15.57:0/2190561527 conn(0x7f5ca80a3950 msgr2=0x7f5ca81ba950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:31.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.170+0000 7f5caecad640 1 -- 172.21.15.57:0/2190561527 shutdown_connections 2024-04-24T01:48:31.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:31.170+0000 7f5caecad640 1 -- 172.21.15.57:0/2190561527 wait complete. 2024-04-24T01:48:31.182 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-24T01:48:31.182 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-24T01:48:31.276 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-04-24T01:48:31.276+0000 7f7933031000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-24T01:48:31.332 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-04-24T01:48:31.331+0000 7f7933031000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-24T01:48:31.454 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-04-24T01:48:31.453+0000 7f7933031000 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-24T01:48:31.584 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-24T01:48:31.691 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.685+0000 7f17d379d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:31.696 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.691+0000 7f17d379d640 1 Processor -- start 2024-04-24T01:48:31.696 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.691+0000 7f17d379d640 1 -- start start 2024-04-24T01:48:31.696 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.693+0000 7f17d379d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f17cc137d60 0x7f17cc13a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:31.696 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.693+0000 7f17d379d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17cc06e620 con 0x7f17cc09fb70 2024-04-24T01:48:31.696 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.693+0000 7f17d379d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f17cc06f590 con 0x7f17cc137d60 2024-04-24T01:48:31.696 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.693+0000 7f17d0d38640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f17cc137d60 0x7f17cc13a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:31.696 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.693+0000 7f17d1539640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f17cc09fb70 0x7f17cc09ff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46630/0 (socket says 172.21.15.57:46630) 2024-04-24T01:48:31.696 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.693+0000 7f17d1539640 1 -- 172.21.15.57:0/719254536 learned_addr learned my addr 172.21.15.57:0/719254536 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T01:48:31.696 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.693+0000 7f17d0d38640 1 -- 172.21.15.57:0/719254536 >> v1:172.21.15.57:6789/0 conn(0x7f17cc09fb70 legacy=0x7f17cc09ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:31.696 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.693+0000 7f17d0d38640 1 -- 172.21.15.57:0/719254536 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17cc06e850 con 0x7f17cc137d60 2024-04-24T01:48:31.697 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.693+0000 7f17c3fff640 1 -- 172.21.15.57:0/719254536 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1982161913 0 0) 0x7f17cc06e620 con 0x7f17cc09fb70 2024-04-24T01:48:31.697 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.693+0000 7f17d0d38640 1 --2- 172.21.15.57:0/719254536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17cc137d60 0x7f17cc13a180 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742c0e9ca0380e25 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:31.697 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.693+0000 7f17c3fff640 1 -- 172.21.15.57:0/719254536 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f17bc009d90 con 0x7f17cc137d60 2024-04-24T01:48:31.697 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.694+0000 7f17c3fff640 1 -- 172.21.15.57:0/719254536 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f17bc00e230 con 0x7f17cc137d60 2024-04-24T01:48:31.697 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.694+0000 7f17c3fff640 1 -- 172.21.15.57:0/719254536 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f17bc00e4d0 con 0x7f17cc137d60 2024-04-24T01:48:31.697 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.694+0000 7f17d379d640 1 -- 172.21.15.57:0/719254536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17cc137d60 msgr2=0x7f17cc13a180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:31.697 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.694+0000 7f17d379d640 1 --2- 172.21.15.57:0/719254536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17cc137d60 0x7f17cc13a180 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:31.697 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.695+0000 7f17d379d640 1 -- 172.21.15.57:0/719254536 shutdown_connections 2024-04-24T01:48:31.697 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.695+0000 7f17d379d640 1 --2- 172.21.15.57:0/719254536 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17cc137d60 0x7f17cc13a180 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:31.697 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.695+0000 7f17d379d640 1 -- 172.21.15.57:0/719254536 >> 172.21.15.57:0/719254536 conn(0x7f17cc0a5140 msgr2=0x7f17cc0a5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:31.697 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.695+0000 7f17d379d640 1 -- 172.21.15.57:0/719254536 shutdown_connections 2024-04-24T01:48:31.697 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.695+0000 7f17d379d640 1 -- 172.21.15.57:0/719254536 wait complete. 2024-04-24T01:48:31.697 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.695+0000 7f17d379d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:31.698 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.697+0000 7f17d379d640 1 Processor -- start 2024-04-24T01:48:31.698 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.697+0000 7f17d379d640 1 -- start start 2024-04-24T01:48:31.700 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.698+0000 7f17d379d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17cc09fb70 0x7f17cc11f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:31.700 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.698+0000 7f17d379d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f17cc1224d0 con 0x7f17cc09fb70 2024-04-24T01:48:31.700 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.698+0000 7f17d1539640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17cc09fb70 0x7f17cc11f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:31.701 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.698+0000 7f17d1539640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17cc09fb70 0x7f17cc11f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40742/0 (socket says 172.21.15.57:40742) 2024-04-24T01:48:31.701 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.698+0000 7f17d1539640 1 -- 172.21.15.57:0/3942875788 learned_addr learned my addr 172.21.15.57:0/3942875788 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T01:48:31.701 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.699+0000 7f17d1539640 1 -- 172.21.15.57:0/3942875788 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17cc120f10 con 0x7f17cc09fb70 2024-04-24T01:48:31.701 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.699+0000 7f17d1539640 1 --2- 172.21.15.57:0/3942875788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17cc09fb70 0x7f17cc11f340 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:31.701 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.699+0000 7f17c1ffb640 1 -- 172.21.15.57:0/3942875788 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f17c8004b80 con 0x7f17cc09fb70 2024-04-24T01:48:31.701 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.699+0000 7f17c1ffb640 1 -- 172.21.15.57:0/3942875788 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f17c8004ce0 con 0x7f17cc09fb70 2024-04-24T01:48:31.701 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.699+0000 7f17c1ffb640 1 -- 172.21.15.57:0/3942875788 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f17c8007120 con 0x7f17cc09fb70 2024-04-24T01:48:31.701 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.699+0000 7f17d379d640 1 -- 172.21.15.57:0/3942875788 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17cc135b40 con 0x7f17cc09fb70 2024-04-24T01:48:31.701 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.699+0000 7f17c1ffb640 1 -- 172.21.15.57:0/3942875788 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (crc 0 0 0) 0x7f17c800c540 con 0x7f17cc09fb70 2024-04-24T01:48:31.701 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.699+0000 7f17d379d640 1 -- 172.21.15.57:0/3942875788 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17cc1217f0 con 0x7f17cc09fb70 2024-04-24T01:48:31.701 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.699+0000 7f17c1ffb640 1 -- 172.21.15.57:0/3942875788 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1207+0+0 (crc 0 0 0) 0x7f17c8007660 con 0x7f17cc09fb70 2024-04-24T01:48:31.702 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.700+0000 7f17d379d640 1 -- 172.21.15.57:0/3942875788 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17cc123400 con 0x7f17cc09fb70 2024-04-24T01:48:31.706 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.705+0000 7f17c1ffb640 1 -- 172.21.15.57:0/3942875788 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (crc 0 0 0) 0x7f17c800e1c0 con 0x7f17cc09fb70 2024-04-24T01:48:31.746 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-04-24T01:48:31.746+0000 7f7933031000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-24T01:48:31.770 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.769+0000 7f17d379d640 1 -- 172.21.15.57:0/3942875788 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f17cc06de00 con 0x7f17cc09fb70 2024-04-24T01:48:31.770 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.769+0000 7f17c1ffb640 1 -- 172.21.15.57:0/3942875788 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v7) ==== 74+0+4152 (crc 0 0 0) 0x7f17c800ca70 con 0x7f17cc09fb70 2024-04-24T01:48:31.770 INFO:teuthology.misc.health.smithi057.stdout: 2024-04-24T01:48:31.771 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":7,"fsid":"2097e8c9-9d10-45f4-a30f-1b3cf153e5e6","created":"2024-04-24T01:48:28.514903+0000","modified":"2024-04-24T01:48:30.670792+0000","last_up_change":"0.000000","last_in_change":"2024-04-24T01:48:30.670792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[],"osds":[{"osd":0,"uuid":"fa3dfb45-b86e-45f6-8763-4e2da341521a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"983d404f-e45f-476b-aba9-7295e360b0c5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7c919704-afb7-4a77-afb5-0480a2a172dd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8f156a3e-e3eb-4b10-85b5-0b3c99a5057e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T01:48:31.771 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.770+0000 7f17d379d640 1 -- 172.21.15.57:0/3942875788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17cc09fb70 msgr2=0x7f17cc11f340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:31.771 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.770+0000 7f17d379d640 1 --2- 172.21.15.57:0/3942875788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17cc09fb70 0x7f17cc11f340 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:31.772 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.770+0000 7f17d379d640 1 -- 172.21.15.57:0/3942875788 shutdown_connections 2024-04-24T01:48:31.772 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.770+0000 7f17d379d640 1 --2- 172.21.15.57:0/3942875788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17cc09fb70 0x7f17cc11f340 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:31.772 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.770+0000 7f17d379d640 1 -- 172.21.15.57:0/3942875788 >> 172.21.15.57:0/3942875788 conn(0x7f17cc0a5140 msgr2=0x7f17cc136780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:31.772 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.770+0000 7f17d379d640 1 -- 172.21.15.57:0/3942875788 shutdown_connections 2024-04-24T01:48:31.772 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:31.770+0000 7f17d379d640 1 -- 172.21.15.57:0/3942875788 wait complete. 2024-04-24T01:48:31.781 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-04-24T01:48:31.796 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-04-24T01:48:31.796+0000 7f7933031000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-24T01:48:31.962 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-04-24T01:48:31.961+0000 7f7933031000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-24T01:48:32.093 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-04-24T01:48:32.093+0000 7f7933031000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-24T01:48:32.143 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-04-24T01:48:32.142+0000 7f7933031000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-24T01:48:32.213 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-04-24T01:48:32.213+0000 7f7933031000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-24T01:48:32.259 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-04-24T01:48:32.259+0000 7f7933031000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-24T01:48:32.780 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-04-24T01:48:32.780+0000 7f7933031000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-24T01:48:32.903 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-04-24T01:48:32.902+0000 7f7933031000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-24T01:48:33.913 INFO:tasks.ceph.mgr.x.smithi084.stderr:2024-04-24T01:48:33.913+0000 7f78d1dc1640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-04-24T01:48:38.186 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-24T01:48:38.299 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.293+0000 7f8b2919d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:38.300 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.299+0000 7f8b2919d640 1 Processor -- start 2024-04-24T01:48:38.300 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.299+0000 7f8b2919d640 1 -- start start 2024-04-24T01:48:38.302 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.300+0000 7f8b2919d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8b24135250 0x7f8b24135660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:38.302 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.300+0000 7f8b2919d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b24134de0 con 0x7f8b2409fe20 2024-04-24T01:48:38.302 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.300+0000 7f8b2919d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f8b240a1270 con 0x7f8b24135250 2024-04-24T01:48:38.302 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.301+0000 7f8b22d9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8b24135250 0x7f8b24135660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:38.302 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.301+0000 7f8b1bfff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8b2409fe20 0x7f8b240a0230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46632/0 (socket says 172.21.15.57:46632) 2024-04-24T01:48:38.302 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.301+0000 7f8b1bfff640 1 -- 172.21.15.57:0/2065070414 learned_addr learned my addr 172.21.15.57:0/2065070414 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T01:48:38.303 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.301+0000 7f8b22d9d640 1 -- 172.21.15.57:0/2065070414 >> v1:172.21.15.57:6789/0 conn(0x7f8b2409fe20 legacy=0x7f8b240a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:38.303 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.301+0000 7f8b22d9d640 1 -- 172.21.15.57:0/2065070414 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b2406d960 con 0x7f8b24135250 2024-04-24T01:48:38.303 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.301+0000 7f8b22d9d640 1 --2- 172.21.15.57:0/2065070414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b24135250 0x7f8b24135660 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653408b6618156a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:38.303 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.301+0000 7f8b2259c640 1 -- 172.21.15.57:0/2065070414 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8b14009d90 con 0x7f8b24135250 2024-04-24T01:48:38.303 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.301+0000 7f8b2259c640 1 -- 172.21.15.57:0/2065070414 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8b1400e230 con 0x7f8b24135250 2024-04-24T01:48:38.303 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.301+0000 7f8b2259c640 1 -- 172.21.15.57:0/2065070414 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8b1400e4d0 con 0x7f8b24135250 2024-04-24T01:48:38.304 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.302+0000 7f8b2919d640 1 -- 172.21.15.57:0/2065070414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b24135250 msgr2=0x7f8b24135660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:38.304 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.302+0000 7f8b2919d640 1 --2- 172.21.15.57:0/2065070414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b24135250 0x7f8b24135660 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:38.304 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.302+0000 7f8b2919d640 1 -- 172.21.15.57:0/2065070414 shutdown_connections 2024-04-24T01:48:38.304 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.302+0000 7f8b2919d640 1 --2- 172.21.15.57:0/2065070414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b24135250 0x7f8b24135660 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:38.304 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.302+0000 7f8b2919d640 1 -- 172.21.15.57:0/2065070414 >> 172.21.15.57:0/2065070414 conn(0x7f8b240a5c00 msgr2=0x7f8b240a6010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:38.304 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.302+0000 7f8b2919d640 1 -- 172.21.15.57:0/2065070414 shutdown_connections 2024-04-24T01:48:38.304 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.302+0000 7f8b2919d640 1 -- 172.21.15.57:0/2065070414 wait complete. 2024-04-24T01:48:38.304 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.303+0000 7f8b2919d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:38.305 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.304+0000 7f8b2919d640 1 Processor -- start 2024-04-24T01:48:38.306 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.305+0000 7f8b2919d640 1 -- start start 2024-04-24T01:48:38.308 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.306+0000 7f8b2919d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b2409fe20 0x7f8b24071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:38.308 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.306+0000 7f8b2919d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8b24072e60 con 0x7f8b2409fe20 2024-04-24T01:48:38.308 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.306+0000 7f8b22d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b2409fe20 0x7f8b24071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:38.308 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.306+0000 7f8b22d9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b2409fe20 0x7f8b24071200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40764/0 (socket says 172.21.15.57:40764) 2024-04-24T01:48:38.308 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.306+0000 7f8b22d9d640 1 -- 172.21.15.57:0/2703863786 learned_addr learned my addr 172.21.15.57:0/2703863786 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T01:48:38.308 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.307+0000 7f8b22d9d640 1 -- 172.21.15.57:0/2703863786 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b2406f230 con 0x7f8b2409fe20 2024-04-24T01:48:38.308 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.307+0000 7f8b22d9d640 1 --2- 172.21.15.57:0/2703863786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b2409fe20 0x7f8b24071200 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:38.308 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.307+0000 7f8b1b7fe640 1 -- 172.21.15.57:0/2703863786 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8b14014540 con 0x7f8b2409fe20 2024-04-24T01:48:38.309 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.307+0000 7f8b1b7fe640 1 -- 172.21.15.57:0/2703863786 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8b140146a0 con 0x7f8b2409fe20 2024-04-24T01:48:38.309 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.307+0000 7f8b2919d640 1 -- 172.21.15.57:0/2703863786 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b2411d4c0 con 0x7f8b2409fe20 2024-04-24T01:48:38.309 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.307+0000 7f8b1b7fe640 1 -- 172.21.15.57:0/2703863786 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8b14014940 con 0x7f8b2409fe20 2024-04-24T01:48:38.309 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.307+0000 7f8b2919d640 1 -- 172.21.15.57:0/2703863786 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b2411ec10 con 0x7f8b2409fe20 2024-04-24T01:48:38.310 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.308+0000 7f8b1b7fe640 1 -- 172.21.15.57:0/2703863786 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 4) ==== 45778+0+0 (crc 0 0 0) 0x7f8b14014af0 con 0x7f8b2409fe20 2024-04-24T01:48:38.310 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.308+0000 7f8b1b7fe640 1 --2- 172.21.15.57:0/2703863786 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f8b040388f0 0x7f8b0403ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:38.310 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.308+0000 7f8b1b7fe640 1 -- 172.21.15.57:0/2703863786 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2319+0+0 (crc 0 0 0) 0x7f8b14019040 con 0x7f8b2409fe20 2024-04-24T01:48:38.310 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.308+0000 7f8b2919d640 1 -- 172.21.15.57:0/2703863786 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b2411eff0 con 0x7f8b2409fe20 2024-04-24T01:48:38.310 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.308+0000 7f8b1bfff640 1 --2- 172.21.15.57:0/2703863786 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f8b040388f0 0x7f8b0403ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:38.310 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.309+0000 7f8b1bfff640 1 --2- 172.21.15.57:0/2703863786 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f8b040388f0 0x7f8b0403ae00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:38.315 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.314+0000 7f8b1b7fe640 1 -- 172.21.15.57:0/2703863786 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f8b14014df0 con 0x7f8b2409fe20 2024-04-24T01:48:38.510 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.509+0000 7f8b2919d640 1 -- 172.21.15.57:0/2703863786 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8b24063900 con 0x7f8b2409fe20 2024-04-24T01:48:38.511 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.510+0000 7f8b1b7fe640 1 -- 172.21.15.57:0/2703863786 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) ==== 74+0+6915 (crc 0 0 0) 0x7f8b1400fb30 con 0x7f8b2409fe20 2024-04-24T01:48:38.511 INFO:teuthology.misc.health.smithi057.stdout: 2024-04-24T01:48:38.511 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":11,"fsid":"2097e8c9-9d10-45f4-a30f-1b3cf153e5e6","created":"2024-04-24T01:48:28.514903+0000","modified":"2024-04-24T01:48:37.964383+0000","last_up_change":"2024-04-24T01:48:34.951142+0000","last_in_change":"2024-04-24T01:48:30.670792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T01:48:36.926526+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fa3dfb45-b86e-45f6-8763-4e2da341521a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6801","nonce":2208289758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2208289758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":2208289758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":2208289758}]},"public_addr":"172.21.15.57:6801/2208289758","cluster_addr":"172.21.15.57:6802/2208289758","heartbeat_back_addr":"172.21.15.57:6807/2208289758","heartbeat_front_addr":"172.21.15.57:6808/2208289758","state":["exists","up"]},{"osd":1,"uuid":"983d404f-e45f-476b-aba9-7295e360b0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6805","nonce":2600611357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2600611357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2600611357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":2600611357}]},"public_addr":"172.21.15.57:6805/2600611357","cluster_addr":"172.21.15.57:6804/2600611357","heartbeat_back_addr":"172.21.15.57:6806/2600611357","heartbeat_front_addr":"172.21.15.57:6803/2600611357","state":["exists","up"]},{"osd":2,"uuid":"7c919704-afb7-4a77-afb5-0480a2a172dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6805","nonce":1003835807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1003835807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":1003835807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1003835807}]},"public_addr":"172.21.15.84:6805/1003835807","cluster_addr":"172.21.15.84:6804/1003835807","heartbeat_back_addr":"172.21.15.84:6807/1003835807","heartbeat_front_addr":"172.21.15.84:6806/1003835807","state":["exists","up"]},{"osd":3,"uuid":"8f156a3e-e3eb-4b10-85b5-0b3c99a5057e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":91137974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6809","nonce":91137974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":91137974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":91137974}]},"public_addr":"172.21.15.84:6808/91137974","cluster_addr":"172.21.15.84:6809/91137974","heartbeat_back_addr":"172.21.15.84:6802/91137974","heartbeat_front_addr":"172.21.15.84:6803/91137974","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T01:48:38.513 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.512+0000 7f8b2919d640 1 -- 172.21.15.57:0/2703863786 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f8b040388f0 msgr2=0x7f8b0403ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:38.514 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.512+0000 7f8b2919d640 1 --2- 172.21.15.57:0/2703863786 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f8b040388f0 0x7f8b0403ae00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:38.514 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.512+0000 7f8b2919d640 1 -- 172.21.15.57:0/2703863786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b2409fe20 msgr2=0x7f8b24071200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:38.514 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.512+0000 7f8b2919d640 1 --2- 172.21.15.57:0/2703863786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b2409fe20 0x7f8b24071200 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:38.514 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.512+0000 7f8b2919d640 1 -- 172.21.15.57:0/2703863786 shutdown_connections 2024-04-24T01:48:38.514 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.512+0000 7f8b2919d640 1 --2- 172.21.15.57:0/2703863786 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f8b040388f0 0x7f8b0403ae00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:38.514 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.512+0000 7f8b2919d640 1 --2- 172.21.15.57:0/2703863786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8b2409fe20 0x7f8b24071200 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:38.514 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.512+0000 7f8b2919d640 1 -- 172.21.15.57:0/2703863786 >> 172.21.15.57:0/2703863786 conn(0x7f8b240a5c00 msgr2=0x7f8b241bcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:38.514 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.512+0000 7f8b2919d640 1 -- 172.21.15.57:0/2703863786 shutdown_connections 2024-04-24T01:48:38.514 INFO:teuthology.misc.health.smithi057.stderr:2024-04-24T01:48:38.512+0000 7f8b2919d640 1 -- 172.21.15.57:0/2703863786 wait complete. 2024-04-24T01:48:38.523 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-04-24T01:48:38.523 INFO:tasks.ceph:Creating RBD pool 2024-04-24T01:48:38.523 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-24T01:48:38.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.628+0000 7fded3d5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:38.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.636+0000 7fded3d5d640 1 Processor -- start 2024-04-24T01:48:38.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.637+0000 7fded3d5d640 1 -- start start 2024-04-24T01:48:38.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.638+0000 7fded3d5d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdecc09ef30 0x7fdecc0a0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:38.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.638+0000 7fded3d5d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdecc09de40 con 0x7fdecc0a0c40 2024-04-24T01:48:38.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.638+0000 7fded3d5d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fdecc0a03f0 con 0x7fdecc09ef30 2024-04-24T01:48:38.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.639+0000 7fded1af9640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdecc09ef30 0x7fdecc0a0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:38.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.639+0000 7fded12f8640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fdecc0a0c40 0x7fdecc1348d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58990/0 (socket says 172.21.15.57:58990) 2024-04-24T01:48:38.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.639+0000 7fded1af9640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdecc09ef30 0x7fdecc0a0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35726/0 (socket says 172.21.15.57:35726) 2024-04-24T01:48:38.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.639+0000 7fded12f8640 1 -- 172.21.15.57:0/3160903967 learned_addr learned my addr 172.21.15.57:0/3160903967 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T01:48:38.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.639+0000 7fded1af9640 1 -- 172.21.15.57:0/3160903967 >> v1:172.21.15.57:6789/0 conn(0x7fdecc0a0c40 legacy=0x7fdecc1348d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:38.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.639+0000 7fded1af9640 1 -- 172.21.15.57:0/3160903967 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdecc09e420 con 0x7fdecc09ef30 2024-04-24T01:48:38.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.639+0000 7fded1af9640 1 --2- 172.21.15.57:0/3160903967 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdecc09ef30 0x7fdecc0a0700 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55495bce31309346 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:38.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.639+0000 7fded0af7640 1 -- 172.21.15.57:0/3160903967 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdec8009d90 con 0x7fdecc09ef30 2024-04-24T01:48:38.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.639+0000 7fded0af7640 1 -- 172.21.15.57:0/3160903967 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdec800e230 con 0x7fdecc09ef30 2024-04-24T01:48:38.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.639+0000 7fded0af7640 1 -- 172.21.15.57:0/3160903967 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdec800e4d0 con 0x7fdecc09ef30 2024-04-24T01:48:38.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.640+0000 7fded3d5d640 1 -- 172.21.15.57:0/3160903967 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdecc09ef30 msgr2=0x7fdecc0a0700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:38.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.640+0000 7fded3d5d640 1 --2- 172.21.15.57:0/3160903967 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdecc09ef30 0x7fdecc0a0700 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:38.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.640+0000 7fded3d5d640 1 -- 172.21.15.57:0/3160903967 shutdown_connections 2024-04-24T01:48:38.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.640+0000 7fded3d5d640 1 --2- 172.21.15.57:0/3160903967 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdecc09ef30 0x7fdecc0a0700 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:38.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.640+0000 7fded3d5d640 1 -- 172.21.15.57:0/3160903967 >> 172.21.15.57:0/3160903967 conn(0x7fdecc06be40 msgr2=0x7fdecc06c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:38.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.640+0000 7fded3d5d640 1 -- 172.21.15.57:0/3160903967 shutdown_connections 2024-04-24T01:48:38.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.640+0000 7fded3d5d640 1 -- 172.21.15.57:0/3160903967 wait complete. 2024-04-24T01:48:38.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.641+0000 7fded3d5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:38.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.643+0000 7fded3d5d640 1 Processor -- start 2024-04-24T01:48:38.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.643+0000 7fded3d5d640 1 -- start start 2024-04-24T01:48:38.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.644+0000 7fded3d5d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdecc09ef30 0x7fdecc11e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:38.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.644+0000 7fded3d5d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fdecc1206a0 con 0x7fdecc09ef30 2024-04-24T01:48:38.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.644+0000 7fded1af9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdecc09ef30 0x7fdecc11e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:38.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.644+0000 7fded1af9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdecc09ef30 0x7fdecc11e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35730/0 (socket says 172.21.15.57:35730) 2024-04-24T01:48:38.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.644+0000 7fded1af9640 1 -- 172.21.15.57:0/1935705329 learned_addr learned my addr 172.21.15.57:0/1935705329 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T01:48:38.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.645+0000 7fded1af9640 1 -- 172.21.15.57:0/1935705329 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdecc121240 con 0x7fdecc09ef30 2024-04-24T01:48:38.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.645+0000 7fded1af9640 1 --2- 172.21.15.57:0/1935705329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdecc09ef30 0x7fdecc11e0f0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:38.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.645+0000 7fdec27fc640 1 -- 172.21.15.57:0/1935705329 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdec8014540 con 0x7fdecc09ef30 2024-04-24T01:48:38.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.645+0000 7fdec27fc640 1 -- 172.21.15.57:0/1935705329 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdec80146a0 con 0x7fdecc09ef30 2024-04-24T01:48:38.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.645+0000 7fdec27fc640 1 -- 172.21.15.57:0/1935705329 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdec8014940 con 0x7fdecc09ef30 2024-04-24T01:48:38.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.645+0000 7fded3d5d640 1 -- 172.21.15.57:0/1935705329 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdecc06ce40 con 0x7fdecc09ef30 2024-04-24T01:48:38.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.645+0000 7fded3d5d640 1 -- 172.21.15.57:0/1935705329 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdecc120c80 con 0x7fdecc09ef30 2024-04-24T01:48:38.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.646+0000 7fdec27fc640 1 -- 172.21.15.57:0/1935705329 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 4) ==== 45778+0+0 (crc 0 0 0) 0x7fdec8014af0 con 0x7fdecc09ef30 2024-04-24T01:48:38.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.646+0000 7fded3d5d640 1 -- 172.21.15.57:0/1935705329 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdecc063900 con 0x7fdecc09ef30 2024-04-24T01:48:38.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.646+0000 7fdec27fc640 1 --2- 172.21.15.57:0/1935705329 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fdeb00388f0 0x7fdeb003ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:38.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.646+0000 7fdec27fc640 1 -- 172.21.15.57:0/1935705329 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 2319+0+0 (crc 0 0 0) 0x7fdec8019040 con 0x7fdecc09ef30 2024-04-24T01:48:38.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.646+0000 7fded12f8640 1 --2- 172.21.15.57:0/1935705329 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fdeb00388f0 0x7fdeb003ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:38.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.647+0000 7fded12f8640 1 --2- 172.21.15.57:0/1935705329 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fdeb00388f0 0x7fdeb003ae00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:38.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.652+0000 7fdec27fc640 1 -- 172.21.15.57:0/1935705329 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fdec800fb70 con 0x7fdecc09ef30 2024-04-24T01:48:38.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.843+0000 7fded3d5d640 1 -- 172.21.15.57:0/1935705329 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7fdecc06ce40 con 0x7fdecc09ef30 2024-04-24T01:48:38.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.977+0000 7fdec27fc640 1 -- 172.21.15.57:0/1935705329 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v12) ==== 109+0+0 (crc 0 0 0) 0x7fdecc06ce40 con 0x7fdecc09ef30 2024-04-24T01:48:38.978 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'rbd' created 2024-04-24T01:48:38.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.980+0000 7fded3d5d640 1 -- 172.21.15.57:0/1935705329 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fdeb00388f0 msgr2=0x7fdeb003ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:38.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.980+0000 7fded3d5d640 1 --2- 172.21.15.57:0/1935705329 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fdeb00388f0 0x7fdeb003ae00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:38.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.980+0000 7fded3d5d640 1 -- 172.21.15.57:0/1935705329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdecc09ef30 msgr2=0x7fdecc11e0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:38.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.980+0000 7fded3d5d640 1 --2- 172.21.15.57:0/1935705329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdecc09ef30 0x7fdecc11e0f0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:38.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.980+0000 7fded3d5d640 1 -- 172.21.15.57:0/1935705329 shutdown_connections 2024-04-24T01:48:38.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.980+0000 7fded3d5d640 1 --2- 172.21.15.57:0/1935705329 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fdeb00388f0 0x7fdeb003ae00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:38.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.980+0000 7fded3d5d640 1 --2- 172.21.15.57:0/1935705329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdecc09ef30 0x7fdecc11e0f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:38.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.980+0000 7fded3d5d640 1 -- 172.21.15.57:0/1935705329 >> 172.21.15.57:0/1935705329 conn(0x7fdecc06be40 msgr2=0x7fdecc1bcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:38.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.980+0000 7fded3d5d640 1 -- 172.21.15.57:0/1935705329 shutdown_connections 2024-04-24T01:48:38.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:38.980+0000 7fded3d5d640 1 -- 172.21.15.57:0/1935705329 wait complete. 2024-04-24T01:48:38.998 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-24T01:48:39.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.117+0000 7f1b020ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:39.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.127+0000 7f1b020ed640 1 Processor -- start 2024-04-24T01:48:39.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.127+0000 7f1b020ed640 1 -- start start 2024-04-24T01:48:39.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.129+0000 7f1b020ed640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1afc09e750 0x7f1afc0a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:39.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.129+0000 7f1b020ed640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1afc09de70 con 0x7f1afc0a1020 2024-04-24T01:48:39.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.129+0000 7f1b020ed640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f1afc0a1430 con 0x7f1afc09e750 2024-04-24T01:48:39.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.129+0000 7f1afb7fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1afc09e750 0x7f1afc0a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:39.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.129+0000 7f1afaffd640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1afc0a1020 0x7f1afc134970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58994/0 (socket says 172.21.15.57:58994) 2024-04-24T01:48:39.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.129+0000 7f1afaffd640 1 -- 172.21.15.57:0/1396213920 learned_addr learned my addr 172.21.15.57:0/1396213920 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T01:48:39.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.129+0000 7f1afa7fc640 1 -- 172.21.15.57:0/1396213920 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2223878434 0 0) 0x7f1afc09de70 con 0x7f1afc0a1020 2024-04-24T01:48:39.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.129+0000 7f1afa7fc640 1 -- 172.21.15.57:0/1396213920 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ae4003580 con 0x7f1afc0a1020 2024-04-24T01:48:39.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.129+0000 7f1afb7fe640 1 -- 172.21.15.57:0/1396213920 >> v1:172.21.15.57:6789/0 conn(0x7f1afc0a1020 legacy=0x7f1afc134970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:39.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.129+0000 7f1afb7fe640 1 -- 172.21.15.57:0/1396213920 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1afc0a0690 con 0x7f1afc09e750 2024-04-24T01:48:39.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.129+0000 7f1afb7fe640 1 --2- 172.21.15.57:0/1396213920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1afc09e750 0x7f1afc0a0ae0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6edf3c32c85739b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:39.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.130+0000 7f1afa7fc640 1 -- 172.21.15.57:0/1396213920 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1aec009d90 con 0x7f1afc09e750 2024-04-24T01:48:39.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.130+0000 7f1afa7fc640 1 -- 172.21.15.57:0/1396213920 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1aec00e230 con 0x7f1afc09e750 2024-04-24T01:48:39.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.130+0000 7f1afa7fc640 1 -- 172.21.15.57:0/1396213920 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1aec00e4d0 con 0x7f1afc09e750 2024-04-24T01:48:39.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.130+0000 7f1b020ed640 1 -- 172.21.15.57:0/1396213920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1afc09e750 msgr2=0x7f1afc0a0ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:39.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.130+0000 7f1b020ed640 1 --2- 172.21.15.57:0/1396213920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1afc09e750 0x7f1afc0a0ae0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:39.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.130+0000 7f1b020ed640 1 -- 172.21.15.57:0/1396213920 shutdown_connections 2024-04-24T01:48:39.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.130+0000 7f1b020ed640 1 --2- 172.21.15.57:0/1396213920 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1afc09e750 0x7f1afc0a0ae0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:39.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.130+0000 7f1b020ed640 1 -- 172.21.15.57:0/1396213920 >> 172.21.15.57:0/1396213920 conn(0x7f1afc0a3d60 msgr2=0x7f1afc0a4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:39.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.130+0000 7f1b020ed640 1 -- 172.21.15.57:0/1396213920 shutdown_connections 2024-04-24T01:48:39.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.130+0000 7f1b020ed640 1 -- 172.21.15.57:0/1396213920 wait complete. 2024-04-24T01:48:39.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.131+0000 7f1b020ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:39.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.132+0000 7f1b020ed640 1 Processor -- start 2024-04-24T01:48:39.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.133+0000 7f1b020ed640 1 -- start start 2024-04-24T01:48:39.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.134+0000 7f1b020ed640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1afc09e750 0x7f1afc11e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:39.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.134+0000 7f1b020ed640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1afc11f5e0 con 0x7f1afc09e750 2024-04-24T01:48:39.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.134+0000 7f1afb7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1afc09e750 0x7f1afc11e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:39.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.134+0000 7f1afb7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1afc09e750 0x7f1afc11e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35748/0 (socket says 172.21.15.57:35748) 2024-04-24T01:48:39.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.134+0000 7f1afb7fe640 1 -- 172.21.15.57:0/780781467 learned_addr learned my addr 172.21.15.57:0/780781467 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T01:48:39.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.134+0000 7f1afb7fe640 1 -- 172.21.15.57:0/780781467 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1afc132480 con 0x7f1afc09e750 2024-04-24T01:48:39.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.135+0000 7f1afb7fe640 1 --2- 172.21.15.57:0/780781467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1afc09e750 0x7f1afc11e0d0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:39.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.135+0000 7f1ae3fff640 1 -- 172.21.15.57:0/780781467 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1aec014410 con 0x7f1afc09e750 2024-04-24T01:48:39.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.135+0000 7f1ae3fff640 1 -- 172.21.15.57:0/780781467 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1aec014570 con 0x7f1afc09e750 2024-04-24T01:48:39.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.135+0000 7f1b020ed640 1 -- 172.21.15.57:0/780781467 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1afc120520 con 0x7f1afc09e750 2024-04-24T01:48:39.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.135+0000 7f1ae3fff640 1 -- 172.21.15.57:0/780781467 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1aec014810 con 0x7f1afc09e750 2024-04-24T01:48:39.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.135+0000 7f1b020ed640 1 -- 172.21.15.57:0/780781467 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1afc122130 con 0x7f1afc09e750 2024-04-24T01:48:39.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.136+0000 7f1b020ed640 1 -- 172.21.15.57:0/780781467 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1afc1208d0 con 0x7f1afc09e750 2024-04-24T01:48:39.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.136+0000 7f1ae3fff640 1 -- 172.21.15.57:0/780781467 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 4) ==== 45778+0+0 (crc 0 0 0) 0x7f1aec0149c0 con 0x7f1afc09e750 2024-04-24T01:48:39.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.136+0000 7f1ae3fff640 1 --2- 172.21.15.57:0/780781467 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f1ae80388f0 0x7f1ae803ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:39.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.136+0000 7f1ae3fff640 1 -- 172.21.15.57:0/780781467 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2661+0+0 (crc 0 0 0) 0x7f1aec019040 con 0x7f1afc09e750 2024-04-24T01:48:39.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.137+0000 7f1afaffd640 1 --2- 172.21.15.57:0/780781467 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f1ae80388f0 0x7f1ae803ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:39.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.137+0000 7f1afaffd640 1 --2- 172.21.15.57:0/780781467 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f1ae80388f0 0x7f1ae803ae00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:39.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.142+0000 7f1ae3fff640 1 -- 172.21.15.57:0/780781467 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f1aec00f990 con 0x7f1afc09e750 2024-04-24T01:48:39.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.334+0000 7f1b020ed640 1 -- 172.21.15.57:0/780781467 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) -- 0x7f1afc069330 con 0x7f1afc09e750 2024-04-24T01:48:39.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.909+0000 7f1ae3fff640 1 -- 172.21.15.57:0/780781467 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f1aec013920 con 0x7f1afc09e750 2024-04-24T01:48:39.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.988+0000 7f1ae3fff640 1 -- 172.21.15.57:0/780781467 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v13) ==== 173+0+0 (crc 0 0 0) 0x7f1aec049d80 con 0x7f1afc09e750 2024-04-24T01:48:39.989 INFO:teuthology.orchestra.run.smithi057.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-24T01:48:39.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.991+0000 7f1b020ed640 1 -- 172.21.15.57:0/780781467 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f1ae80388f0 msgr2=0x7f1ae803ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:39.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.991+0000 7f1b020ed640 1 --2- 172.21.15.57:0/780781467 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f1ae80388f0 0x7f1ae803ae00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:39.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.991+0000 7f1b020ed640 1 -- 172.21.15.57:0/780781467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1afc09e750 msgr2=0x7f1afc11e0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:39.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.991+0000 7f1b020ed640 1 --2- 172.21.15.57:0/780781467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1afc09e750 0x7f1afc11e0d0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:39.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.991+0000 7f1b020ed640 1 -- 172.21.15.57:0/780781467 shutdown_connections 2024-04-24T01:48:39.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.991+0000 7f1b020ed640 1 --2- 172.21.15.57:0/780781467 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f1ae80388f0 0x7f1ae803ae00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:39.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.991+0000 7f1b020ed640 1 --2- 172.21.15.57:0/780781467 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1afc09e750 0x7f1afc11e0d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:39.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.991+0000 7f1b020ed640 1 -- 172.21.15.57:0/780781467 >> 172.21.15.57:0/780781467 conn(0x7f1afc0a3d60 msgr2=0x7f1afc1ba9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:39.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.991+0000 7f1b020ed640 1 -- 172.21.15.57:0/780781467 shutdown_connections 2024-04-24T01:48:39.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:39.991+0000 7f1b020ed640 1 -- 172.21.15.57:0/780781467 wait complete. 2024-04-24T01:48:40.015 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-24T01:48:40.015 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-24T01:48:40.015 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-24T01:48:40.015 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-24T01:48:40.016 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-24T01:48:40.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.144+0000 7f19672ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:40.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.148+0000 7f19672ad640 1 Processor -- start 2024-04-24T01:48:40.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.149+0000 7f19672ad640 1 -- start start 2024-04-24T01:48:40.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.150+0000 7f19672ad640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f19600a1150 0x7f1960139f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:40.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.150+0000 7f19672ad640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f196006dd10 con 0x7f19600a0630 2024-04-24T01:48:40.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.150+0000 7f19672ad640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f196006dab0 con 0x7f19600a1150 2024-04-24T01:48:40.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.150+0000 7f1964848640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f19600a1150 0x7f1960139f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:40.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.150+0000 7f1965049640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f19600a0630 0x7f19600a0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59008/0 (socket says 172.21.15.57:59008) 2024-04-24T01:48:40.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.150+0000 7f1965049640 1 -- 172.21.15.57:0/281942611 learned_addr learned my addr 172.21.15.57:0/281942611 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T01:48:40.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.151+0000 7f1964848640 1 -- 172.21.15.57:0/281942611 >> v1:172.21.15.57:6789/0 conn(0x7f19600a0630 legacy=0x7f19600a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:40.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.151+0000 7f195ffff640 1 -- 172.21.15.57:0/281942611 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 373514044 0 0) 0x7f196006dd10 con 0x7f19600a0630 2024-04-24T01:48:40.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.151+0000 7f1964848640 1 -- 172.21.15.57:0/281942611 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f196006d7d0 con 0x7f19600a1150 2024-04-24T01:48:40.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.151+0000 7f1964848640 1 --2- 172.21.15.57:0/281942611 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19600a1150 0x7f1960139f80 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12184452a5fa4b8f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:40.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.151+0000 7f195ffff640 1 -- 172.21.15.57:0/281942611 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1954009d90 con 0x7f19600a1150 2024-04-24T01:48:40.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.151+0000 7f195ffff640 1 -- 172.21.15.57:0/281942611 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f195400e230 con 0x7f19600a1150 2024-04-24T01:48:40.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.151+0000 7f195ffff640 1 -- 172.21.15.57:0/281942611 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f195400e4d0 con 0x7f19600a1150 2024-04-24T01:48:40.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.152+0000 7f19672ad640 1 -- 172.21.15.57:0/281942611 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19600a1150 msgr2=0x7f1960139f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:40.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.152+0000 7f19672ad640 1 --2- 172.21.15.57:0/281942611 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19600a1150 0x7f1960139f80 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:40.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.152+0000 7f19672ad640 1 -- 172.21.15.57:0/281942611 shutdown_connections 2024-04-24T01:48:40.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.152+0000 7f19672ad640 1 --2- 172.21.15.57:0/281942611 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19600a1150 0x7f1960139f80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:40.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.152+0000 7f19672ad640 1 -- 172.21.15.57:0/281942611 >> 172.21.15.57:0/281942611 conn(0x7f196009aa00 msgr2=0x7f196009ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:40.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.152+0000 7f19672ad640 1 -- 172.21.15.57:0/281942611 shutdown_connections 2024-04-24T01:48:40.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.152+0000 7f19672ad640 1 -- 172.21.15.57:0/281942611 wait complete. 2024-04-24T01:48:40.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.152+0000 7f19672ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:40.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.154+0000 7f19672ad640 1 Processor -- start 2024-04-24T01:48:40.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.154+0000 7f19672ad640 1 -- start start 2024-04-24T01:48:40.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.155+0000 7f19672ad640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19600a0630 0x7f196011f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:40.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.155+0000 7f19672ad640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1960120b90 con 0x7f19600a0630 2024-04-24T01:48:40.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.156+0000 7f1965049640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19600a0630 0x7f196011f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:40.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.156+0000 7f1965049640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19600a0630 0x7f196011f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35756/0 (socket says 172.21.15.57:35756) 2024-04-24T01:48:40.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.156+0000 7f1965049640 1 -- 172.21.15.57:0/3965735317 learned_addr learned my addr 172.21.15.57:0/3965735317 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T01:48:40.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.156+0000 7f1965049640 1 -- 172.21.15.57:0/3965735317 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1960121970 con 0x7f19600a0630 2024-04-24T01:48:40.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.156+0000 7f1965049640 1 --2- 172.21.15.57:0/3965735317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19600a0630 0x7f196011f680 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:40.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.156+0000 7f195dffb640 1 -- 172.21.15.57:0/3965735317 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1950004cf0 con 0x7f19600a0630 2024-04-24T01:48:40.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.156+0000 7f195dffb640 1 -- 172.21.15.57:0/3965735317 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1950004e50 con 0x7f19600a0630 2024-04-24T01:48:40.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.156+0000 7f195dffb640 1 -- 172.21.15.57:0/3965735317 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1950007250 con 0x7f19600a0630 2024-04-24T01:48:40.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.156+0000 7f19672ad640 1 -- 172.21.15.57:0/3965735317 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1960072810 con 0x7f19600a0630 2024-04-24T01:48:40.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.156+0000 7f19672ad640 1 -- 172.21.15.57:0/3965735317 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19600732f0 con 0x7f19600a0630 2024-04-24T01:48:40.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.157+0000 7f195dffb640 1 -- 172.21.15.57:0/3965735317 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f1950007400 con 0x7f19600a0630 2024-04-24T01:48:40.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.157+0000 7f19672ad640 1 -- 172.21.15.57:0/3965735317 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1960063900 con 0x7f19600a0630 2024-04-24T01:48:40.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.157+0000 7f195dffb640 1 --2- 172.21.15.57:0/3965735317 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f194c038980 0x7f194c03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:40.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.157+0000 7f195dffb640 1 -- 172.21.15.57:0/3965735317 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2672+0+0 (crc 0 0 0) 0x7f19500489e0 con 0x7f19600a0630 2024-04-24T01:48:40.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.158+0000 7f1964848640 1 --2- 172.21.15.57:0/3965735317 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f194c038980 0x7f194c03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:40.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.158+0000 7f1964848640 1 --2- 172.21.15.57:0/3965735317 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f194c038980 0x7f194c03ae90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:40.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.163+0000 7f195dffb640 1 -- 172.21.15.57:0/3965735317 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f19500060b0 con 0x7f19600a0630 2024-04-24T01:48:40.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.402+0000 7f19672ad640 1 -- 172.21.15.57:0/3965735317 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f1960120820 con 0x7f19600a0630 2024-04-24T01:48:40.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.404+0000 7f195dffb640 1 -- 172.21.15.57:0/3965735317 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+87795 (crc 0 0 0) 0x7f195000ad00 con 0x7f19600a0630 2024-04-24T01:48:40.407 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:40.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.406+0000 7f19672ad640 1 -- 172.21.15.57:0/3965735317 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f194c038980 msgr2=0x7f194c03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:40.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.406+0000 7f19672ad640 1 --2- 172.21.15.57:0/3965735317 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f194c038980 0x7f194c03ae90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:40.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.406+0000 7f19672ad640 1 -- 172.21.15.57:0/3965735317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19600a0630 msgr2=0x7f196011f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:40.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.406+0000 7f19672ad640 1 --2- 172.21.15.57:0/3965735317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19600a0630 0x7f196011f680 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:40.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.406+0000 7f19672ad640 1 -- 172.21.15.57:0/3965735317 shutdown_connections 2024-04-24T01:48:40.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.406+0000 7f19672ad640 1 --2- 172.21.15.57:0/3965735317 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f194c038980 0x7f194c03ae90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:40.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.406+0000 7f19672ad640 1 --2- 172.21.15.57:0/3965735317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f19600a0630 0x7f196011f680 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:40.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.406+0000 7f19672ad640 1 -- 172.21.15.57:0/3965735317 >> 172.21.15.57:0/3965735317 conn(0x7f196009aa00 msgr2=0x7f196009e1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:40.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.406+0000 7f19672ad640 1 -- 172.21.15.57:0/3965735317 shutdown_connections 2024-04-24T01:48:40.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.406+0000 7f19672ad640 1 -- 172.21.15.57:0/3965735317 wait complete. 2024-04-24T01:48:40.418 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6800","nonce":1747524692},{"type":"v1","addr":"172.21.15.84:6801","nonce":1747524692}]},"active_addr":"172.21.15.84:6801/1747524692","active_change":"2024-04-24T01:48:32.905206+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":47616984}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":2628943153}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":3161520470}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.84:0","nonce":29902022}]}]} 2024-04-24T01:48:40.421 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-24T01:48:40.421 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-24T01:48:40.421 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T01:48:40.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.528+0000 7f1c0675d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:40.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.533+0000 7f1c0675d640 1 Processor -- start 2024-04-24T01:48:40.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.533+0000 7f1c0675d640 1 -- start start 2024-04-24T01:48:40.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.535+0000 7f1c0675d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1c000a2fe0 0x7f1c00139ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:40.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.535+0000 7f1c0675d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c000a0120 con 0x7f1c0009e7c0 2024-04-24T01:48:40.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.535+0000 7f1c0675d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f1c0006f270 con 0x7f1c000a2fe0 2024-04-24T01:48:40.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.535+0000 7f1bff7fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1c000a2fe0 0x7f1c00139ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:40.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.535+0000 7f1bfffff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1c0009e7c0 0x7f1c000a28d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59016/0 (socket says 172.21.15.57:59016) 2024-04-24T01:48:40.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.535+0000 7f1bfffff640 1 -- 172.21.15.57:0/893001436 learned_addr learned my addr 172.21.15.57:0/893001436 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T01:48:40.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.535+0000 7f1bff7fe640 1 -- 172.21.15.57:0/893001436 >> v1:172.21.15.57:6789/0 conn(0x7f1c0009e7c0 legacy=0x7f1c000a28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:40.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.535+0000 7f1bff7fe640 1 -- 172.21.15.57:0/893001436 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c0009e430 con 0x7f1c000a2fe0 2024-04-24T01:48:40.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.535+0000 7f1bff7fe640 1 --2- 172.21.15.57:0/893001436 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c000a2fe0 0x7f1c00139ea0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2630a275ed3285f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:40.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.535+0000 7f1bfeffd640 1 -- 172.21.15.57:0/893001436 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1bf0009d90 con 0x7f1c000a2fe0 2024-04-24T01:48:40.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.535+0000 7f1bfeffd640 1 -- 172.21.15.57:0/893001436 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1bf000e230 con 0x7f1c000a2fe0 2024-04-24T01:48:40.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.535+0000 7f1bfeffd640 1 -- 172.21.15.57:0/893001436 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1bf000e4d0 con 0x7f1c000a2fe0 2024-04-24T01:48:40.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.536+0000 7f1c0675d640 1 -- 172.21.15.57:0/893001436 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c000a2fe0 msgr2=0x7f1c00139ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:40.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.536+0000 7f1c0675d640 1 --2- 172.21.15.57:0/893001436 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c000a2fe0 0x7f1c00139ea0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:40.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.536+0000 7f1c0675d640 1 -- 172.21.15.57:0/893001436 shutdown_connections 2024-04-24T01:48:40.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.536+0000 7f1c0675d640 1 --2- 172.21.15.57:0/893001436 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c000a2fe0 0x7f1c00139ea0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:40.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.536+0000 7f1c0675d640 1 -- 172.21.15.57:0/893001436 >> 172.21.15.57:0/893001436 conn(0x7f1c0006e2c0 msgr2=0x7f1c0006e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:40.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.536+0000 7f1c0675d640 1 -- 172.21.15.57:0/893001436 shutdown_connections 2024-04-24T01:48:40.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.536+0000 7f1c0675d640 1 -- 172.21.15.57:0/893001436 wait complete. 2024-04-24T01:48:40.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.536+0000 7f1c0675d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:40.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.538+0000 7f1c0675d640 1 Processor -- start 2024-04-24T01:48:40.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.538+0000 7f1c0675d640 1 -- start start 2024-04-24T01:48:40.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.540+0000 7f1c0675d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c000a2fe0 0x7f1c00121180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:40.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.540+0000 7f1c0675d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1c00124820 con 0x7f1c000a2fe0 2024-04-24T01:48:40.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.540+0000 7f1bfffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c000a2fe0 0x7f1c00121180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:40.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.540+0000 7f1bfffff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c000a2fe0 0x7f1c00121180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35778/0 (socket says 172.21.15.57:35778) 2024-04-24T01:48:40.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.540+0000 7f1bfffff640 1 -- 172.21.15.57:0/410025143 learned_addr learned my addr 172.21.15.57:0/410025143 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T01:48:40.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.540+0000 7f1bfffff640 1 -- 172.21.15.57:0/410025143 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c001321b0 con 0x7f1c000a2fe0 2024-04-24T01:48:40.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.540+0000 7f1bfffff640 1 --2- 172.21.15.57:0/410025143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c000a2fe0 0x7f1c00121180 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:40.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.541+0000 7f1bfcff9640 1 -- 172.21.15.57:0/410025143 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1be8005a60 con 0x7f1c000a2fe0 2024-04-24T01:48:40.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.541+0000 7f1bfcff9640 1 -- 172.21.15.57:0/410025143 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f1be8005bc0 con 0x7f1c000a2fe0 2024-04-24T01:48:40.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.541+0000 7f1c0675d640 1 -- 172.21.15.57:0/410025143 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c001324a0 con 0x7f1c000a2fe0 2024-04-24T01:48:40.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.541+0000 7f1bfcff9640 1 -- 172.21.15.57:0/410025143 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f1be8005e60 con 0x7f1c000a2fe0 2024-04-24T01:48:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.541+0000 7f1c0675d640 1 -- 172.21.15.57:0/410025143 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c00122d50 con 0x7f1c000a2fe0 2024-04-24T01:48:40.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.542+0000 7f1bfcff9640 1 -- 172.21.15.57:0/410025143 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f1be800c780 con 0x7f1c000a2fe0 2024-04-24T01:48:40.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.542+0000 7f1c0675d640 1 -- 172.21.15.57:0/410025143 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c0006cf60 con 0x7f1c000a2fe0 2024-04-24T01:48:40.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.542+0000 7f1bfcff9640 1 --2- 172.21.15.57:0/410025143 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f1be0038980 0x7f1be003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:40.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.542+0000 7f1bfcff9640 1 -- 172.21.15.57:0/410025143 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2672+0+0 (crc 0 0 0) 0x7f1be8048190 con 0x7f1c000a2fe0 2024-04-24T01:48:40.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.542+0000 7f1bff7fe640 1 --2- 172.21.15.57:0/410025143 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f1be0038980 0x7f1be003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:40.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.543+0000 7f1bff7fe640 1 --2- 172.21.15.57:0/410025143 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f1be0038980 0x7f1be003ae90 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:40.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.547+0000 7f1bfcff9640 1 -- 172.21.15.57:0/410025143 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f1be800d330 con 0x7f1c000a2fe0 2024-04-24T01:48:40.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.735+0000 7f1c0675d640 1 -- 172.21.15.57:0/410025143 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1c00063900 con 0x7f1c000a2fe0 2024-04-24T01:48:40.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.736+0000 7f1bfcff9640 1 -- 172.21.15.57:0/410025143 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+8707 (crc 0 0 0) 0x7f1be800d150 con 0x7f1c000a2fe0 2024-04-24T01:48:40.737 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:40.737 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":13,"fsid":"2097e8c9-9d10-45f4-a30f-1b3cf153e5e6","created":"2024-04-24T01:48:28.514903+0000","modified":"2024-04-24T01:48:39.979460+0000","last_up_change":"2024-04-24T01:48:34.951142+0000","last_in_change":"2024-04-24T01:48:30.670792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T01:48:36.926526+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-24T01:48:38.847556+0000","flags":294945,"flags_names":"hashpspool,nopgchange,creating,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fa3dfb45-b86e-45f6-8763-4e2da341521a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6801","nonce":2208289758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2208289758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":2208289758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":2208289758}]},"public_addr":"172.21.15.57:6801/2208289758","cluster_addr":"172.21.15.57:6802/2208289758","heartbeat_back_addr":"172.21.15.57:6807/2208289758","heartbeat_front_addr":"172.21.15.57:6808/2208289758","state":["exists","up"]},{"osd":1,"uuid":"983d404f-e45f-476b-aba9-7295e360b0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6805","nonce":2600611357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2600611357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2600611357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":2600611357}]},"public_addr":"172.21.15.57:6805/2600611357","cluster_addr":"172.21.15.57:6804/2600611357","heartbeat_back_addr":"172.21.15.57:6806/2600611357","heartbeat_front_addr":"172.21.15.57:6803/2600611357","state":["exists","up"]},{"osd":2,"uuid":"7c919704-afb7-4a77-afb5-0480a2a172dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6805","nonce":1003835807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1003835807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":1003835807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1003835807}]},"public_addr":"172.21.15.84:6805/1003835807","cluster_addr":"172.21.15.84:6804/1003835807","heartbeat_back_addr":"172.21.15.84:6807/1003835807","heartbeat_front_addr":"172.21.15.84:6806/1003835807","state":["exists","up"]},{"osd":3,"uuid":"8f156a3e-e3eb-4b10-85b5-0b3c99a5057e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":91137974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6809","nonce":91137974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":91137974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":91137974}]},"public_addr":"172.21.15.84:6808/91137974","cluster_addr":"172.21.15.84:6809/91137974","heartbeat_back_addr":"172.21.15.84:6802/91137974","heartbeat_front_addr":"172.21.15.84:6803/91137974","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T01:48:40.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.738+0000 7f1c0675d640 1 -- 172.21.15.57:0/410025143 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f1be0038980 msgr2=0x7f1be003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:40.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.738+0000 7f1c0675d640 1 --2- 172.21.15.57:0/410025143 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f1be0038980 0x7f1be003ae90 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:40.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.738+0000 7f1c0675d640 1 -- 172.21.15.57:0/410025143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c000a2fe0 msgr2=0x7f1c00121180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:40.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.738+0000 7f1c0675d640 1 --2- 172.21.15.57:0/410025143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c000a2fe0 0x7f1c00121180 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:40.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.738+0000 7f1c0675d640 1 -- 172.21.15.57:0/410025143 shutdown_connections 2024-04-24T01:48:40.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.738+0000 7f1c0675d640 1 --2- 172.21.15.57:0/410025143 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f1be0038980 0x7f1be003ae90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:40.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.738+0000 7f1c0675d640 1 --2- 172.21.15.57:0/410025143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1c000a2fe0 0x7f1c00121180 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:40.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.738+0000 7f1c0675d640 1 -- 172.21.15.57:0/410025143 >> 172.21.15.57:0/410025143 conn(0x7f1c0006e2c0 msgr2=0x7f1c0009aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:40.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.738+0000 7f1c0675d640 1 -- 172.21.15.57:0/410025143 shutdown_connections 2024-04-24T01:48:40.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.738+0000 7f1c0675d640 1 -- 172.21.15.57:0/410025143 wait complete. 2024-04-24T01:48:40.750 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-24T01:48:40.750 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T01:48:40.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.856+0000 7fb2f7f9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:40.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.861+0000 7fb2f7f9d640 1 Processor -- start 2024-04-24T01:48:40.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.861+0000 7fb2f7f9d640 1 -- start start 2024-04-24T01:48:40.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.862+0000 7fb2f7f9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb2f00a2fe0 0x7fb2f0139ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:40.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.862+0000 7fb2f7f9d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2f00a0120 con 0x7fb2f009e7c0 2024-04-24T01:48:40.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.862+0000 7fb2f7f9d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fb2f006f270 con 0x7fb2f00a2fe0 2024-04-24T01:48:40.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.862+0000 7fb2f5538640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb2f00a2fe0 0x7fb2f0139ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:40.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.862+0000 7fb2f5d39640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb2f009e7c0 0x7fb2f00a28d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59020/0 (socket says 172.21.15.57:59020) 2024-04-24T01:48:40.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.862+0000 7fb2f5d39640 1 -- 172.21.15.57:0/1288498399 learned_addr learned my addr 172.21.15.57:0/1288498399 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T01:48:40.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.863+0000 7fb2f5538640 1 -- 172.21.15.57:0/1288498399 >> v1:172.21.15.57:6789/0 conn(0x7fb2f009e7c0 legacy=0x7fb2f00a28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:40.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.863+0000 7fb2f5538640 1 -- 172.21.15.57:0/1288498399 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2f009e430 con 0x7fb2f00a2fe0 2024-04-24T01:48:40.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.863+0000 7fb2f4d37640 1 -- 172.21.15.57:0/1288498399 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3182325292 0 0) 0x7fb2f00a0120 con 0x7fb2f009e7c0 2024-04-24T01:48:40.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.863+0000 7fb2f5538640 1 --2- 172.21.15.57:0/1288498399 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2f00a2fe0 0x7fb2f0139ea0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6932c13564d1fa server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:40.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.863+0000 7fb2f4d37640 1 -- 172.21.15.57:0/1288498399 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb2e4009d90 con 0x7fb2f00a2fe0 2024-04-24T01:48:40.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.863+0000 7fb2f4d37640 1 -- 172.21.15.57:0/1288498399 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb2e400e230 con 0x7fb2f00a2fe0 2024-04-24T01:48:40.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.863+0000 7fb2f4d37640 1 -- 172.21.15.57:0/1288498399 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb2e400e4d0 con 0x7fb2f00a2fe0 2024-04-24T01:48:40.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.864+0000 7fb2f7f9d640 1 -- 172.21.15.57:0/1288498399 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2f00a2fe0 msgr2=0x7fb2f0139ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:40.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.864+0000 7fb2f7f9d640 1 --2- 172.21.15.57:0/1288498399 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2f00a2fe0 0x7fb2f0139ea0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:40.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.864+0000 7fb2f7f9d640 1 -- 172.21.15.57:0/1288498399 shutdown_connections 2024-04-24T01:48:40.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.864+0000 7fb2f7f9d640 1 --2- 172.21.15.57:0/1288498399 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2f00a2fe0 0x7fb2f0139ea0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:40.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.864+0000 7fb2f7f9d640 1 -- 172.21.15.57:0/1288498399 >> 172.21.15.57:0/1288498399 conn(0x7fb2f006e2c0 msgr2=0x7fb2f006e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:40.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.864+0000 7fb2f7f9d640 1 -- 172.21.15.57:0/1288498399 shutdown_connections 2024-04-24T01:48:40.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.864+0000 7fb2f7f9d640 1 -- 172.21.15.57:0/1288498399 wait complete. 2024-04-24T01:48:40.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.864+0000 7fb2f7f9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:40.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.866+0000 7fb2f7f9d640 1 Processor -- start 2024-04-24T01:48:40.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.866+0000 7fb2f7f9d640 1 -- start start 2024-04-24T01:48:40.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.867+0000 7fb2f7f9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2f00a2fe0 0x7fb2f01c6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:40.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.868+0000 7fb2f7f9d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f0123470 con 0x7fb2f00a2fe0 2024-04-24T01:48:40.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.868+0000 7fb2f5d39640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2f00a2fe0 0x7fb2f01c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:40.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.868+0000 7fb2f5d39640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2f00a2fe0 0x7fb2f01c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35804/0 (socket says 172.21.15.57:35804) 2024-04-24T01:48:40.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.868+0000 7fb2f5d39640 1 -- 172.21.15.57:0/2889879424 learned_addr learned my addr 172.21.15.57:0/2889879424 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T01:48:40.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.868+0000 7fb2f5d39640 1 -- 172.21.15.57:0/2889879424 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2f01c5b10 con 0x7fb2f00a2fe0 2024-04-24T01:48:40.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.868+0000 7fb2f5d39640 1 --2- 172.21.15.57:0/2889879424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2f00a2fe0 0x7fb2f01c6130 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:40.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.868+0000 7fb2ee7fc640 1 -- 172.21.15.57:0/2889879424 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb2e8004cf0 con 0x7fb2f00a2fe0 2024-04-24T01:48:40.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.868+0000 7fb2ee7fc640 1 -- 172.21.15.57:0/2889879424 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb2e8004e50 con 0x7fb2f00a2fe0 2024-04-24T01:48:40.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.868+0000 7fb2f7f9d640 1 -- 172.21.15.57:0/2889879424 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2f01c5e20 con 0x7fb2f00a2fe0 2024-04-24T01:48:40.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.868+0000 7fb2ee7fc640 1 -- 172.21.15.57:0/2889879424 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb2e8007250 con 0x7fb2f00a2fe0 2024-04-24T01:48:40.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.868+0000 7fb2f7f9d640 1 -- 172.21.15.57:0/2889879424 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2f0123c60 con 0x7fb2f00a2fe0 2024-04-24T01:48:40.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.869+0000 7fb2ee7fc640 1 -- 172.21.15.57:0/2889879424 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fb2e8007400 con 0x7fb2f00a2fe0 2024-04-24T01:48:40.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.869+0000 7fb2f7f9d640 1 -- 172.21.15.57:0/2889879424 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2f0063900 con 0x7fb2f00a2fe0 2024-04-24T01:48:40.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.870+0000 7fb2ee7fc640 1 --2- 172.21.15.57:0/2889879424 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fb2dc038980 0x7fb2dc03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:40.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.870+0000 7fb2ee7fc640 1 -- 172.21.15.57:0/2889879424 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2672+0+0 (crc 0 0 0) 0x7fb2e8048ae0 con 0x7fb2f00a2fe0 2024-04-24T01:48:40.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.870+0000 7fb2f5538640 1 --2- 172.21.15.57:0/2889879424 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fb2dc038980 0x7fb2dc03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:40.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.870+0000 7fb2f5538640 1 --2- 172.21.15.57:0/2889879424 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fb2dc038980 0x7fb2dc03ae90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:40.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:40.875+0000 7fb2ee7fc640 1 -- 172.21.15.57:0/2889879424 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fb2e80060b0 con 0x7fb2f00a2fe0 2024-04-24T01:48:41.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.065+0000 7fb2f7f9d640 1 -- 172.21.15.57:0/2889879424 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb2f0068ea0 con 0x7fb2f00a2fe0 2024-04-24T01:48:41.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.066+0000 7fb2ee7fc640 1 -- 172.21.15.57:0/2889879424 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8698 (crc 0 0 0) 0x7fb2e800ad00 con 0x7fb2f00a2fe0 2024-04-24T01:48:41.067 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:41.067 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":14,"fsid":"2097e8c9-9d10-45f4-a30f-1b3cf153e5e6","created":"2024-04-24T01:48:28.514903+0000","modified":"2024-04-24T01:48:40.989606+0000","last_up_change":"2024-04-24T01:48:34.951142+0000","last_in_change":"2024-04-24T01:48:30.670792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T01:48:36.926526+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-24T01:48:38.847556+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fa3dfb45-b86e-45f6-8763-4e2da341521a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6801","nonce":2208289758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2208289758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":2208289758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":2208289758}]},"public_addr":"172.21.15.57:6801/2208289758","cluster_addr":"172.21.15.57:6802/2208289758","heartbeat_back_addr":"172.21.15.57:6807/2208289758","heartbeat_front_addr":"172.21.15.57:6808/2208289758","state":["exists","up"]},{"osd":1,"uuid":"983d404f-e45f-476b-aba9-7295e360b0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6805","nonce":2600611357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2600611357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2600611357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":2600611357}]},"public_addr":"172.21.15.57:6805/2600611357","cluster_addr":"172.21.15.57:6804/2600611357","heartbeat_back_addr":"172.21.15.57:6806/2600611357","heartbeat_front_addr":"172.21.15.57:6803/2600611357","state":["exists","up"]},{"osd":2,"uuid":"7c919704-afb7-4a77-afb5-0480a2a172dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6805","nonce":1003835807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1003835807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":1003835807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1003835807}]},"public_addr":"172.21.15.84:6805/1003835807","cluster_addr":"172.21.15.84:6804/1003835807","heartbeat_back_addr":"172.21.15.84:6807/1003835807","heartbeat_front_addr":"172.21.15.84:6806/1003835807","state":["exists","up"]},{"osd":3,"uuid":"8f156a3e-e3eb-4b10-85b5-0b3c99a5057e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":91137974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6809","nonce":91137974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":91137974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":91137974}]},"public_addr":"172.21.15.84:6808/91137974","cluster_addr":"172.21.15.84:6809/91137974","heartbeat_back_addr":"172.21.15.84:6802/91137974","heartbeat_front_addr":"172.21.15.84:6803/91137974","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T01:48:41.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.068+0000 7fb2f7f9d640 1 -- 172.21.15.57:0/2889879424 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fb2dc038980 msgr2=0x7fb2dc03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.068+0000 7fb2f7f9d640 1 --2- 172.21.15.57:0/2889879424 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fb2dc038980 0x7fb2dc03ae90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.068+0000 7fb2f7f9d640 1 -- 172.21.15.57:0/2889879424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2f00a2fe0 msgr2=0x7fb2f01c6130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.068+0000 7fb2f7f9d640 1 --2- 172.21.15.57:0/2889879424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2f00a2fe0 0x7fb2f01c6130 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.068+0000 7fb2f7f9d640 1 -- 172.21.15.57:0/2889879424 shutdown_connections 2024-04-24T01:48:41.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.068+0000 7fb2f7f9d640 1 --2- 172.21.15.57:0/2889879424 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fb2dc038980 0x7fb2dc03ae90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.068+0000 7fb2f7f9d640 1 --2- 172.21.15.57:0/2889879424 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2f00a2fe0 0x7fb2f01c6130 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.068+0000 7fb2f7f9d640 1 -- 172.21.15.57:0/2889879424 >> 172.21.15.57:0/2889879424 conn(0x7fb2f006e2c0 msgr2=0x7fb2f009aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:41.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.068+0000 7fb2f7f9d640 1 -- 172.21.15.57:0/2889879424 shutdown_connections 2024-04-24T01:48:41.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.068+0000 7fb2f7f9d640 1 -- 172.21.15.57:0/2889879424 wait complete. 2024-04-24T01:48:41.080 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-24T01:48:41.081 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-24T01:48:41.081 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-24T01:48:41.081 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-24T01:48:41.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.197+0000 7f2f76ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:41.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.197+0000 7f71cf06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:41.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.197+0000 7ff2c431d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:41.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.197+0000 7f909766d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:41.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.203+0000 7ff2c431d640 1 Processor -- start 2024-04-24T01:48:41.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.203+0000 7ff2c431d640 1 -- start start 2024-04-24T01:48:41.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.204+0000 7f71cf06d640 1 Processor -- start 2024-04-24T01:48:41.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.204+0000 7f71cf06d640 1 -- start start 2024-04-24T01:48:41.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.204+0000 7f2f76ead640 1 Processor -- start 2024-04-24T01:48:41.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.204+0000 7f2f76ead640 1 -- start start 2024-04-24T01:48:41.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.204+0000 7f909766d640 1 Processor -- start 2024-04-24T01:48:41.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.204+0000 7f909766d640 1 -- start start 2024-04-24T01:48:41.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.205+0000 7ff2c431d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff2bc137c50 0x7ff2bc13a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.205+0000 7f71cf06d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f71c81359e0 0x7f71c8137e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.205+0000 7f71cf06d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71c8070300 con 0x7f71c8132c40 2024-04-24T01:48:41.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.205+0000 7ff2c431d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2bc0a0000 con 0x7ff2bc09e710 2024-04-24T01:48:41.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.205+0000 7f71cf06d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f71c809de90 con 0x7f71c81359e0 2024-04-24T01:48:41.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.205+0000 7ff2c431d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7ff2bc09e3c0 con 0x7ff2bc137c50 2024-04-24T01:48:41.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.206+0000 7f71cce09640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f71c8132c40 0x7f71c8133050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59038/0 (socket says 172.21.15.57:59038) 2024-04-24T01:48:41.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.206+0000 7f71c7fff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f71c81359e0 0x7f71c8137e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:41.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.206+0000 7f71cce09640 1 -- 172.21.15.57:0/4077581948 learned_addr learned my addr 172.21.15.57:0/4077581948 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T01:48:41.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.206+0000 7ff2c18b8640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff2bc137c50 0x7ff2bc13a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:41.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.206+0000 7ff2c18b8640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff2bc137c50 0x7ff2bc13a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35814/0 (socket says 172.21.15.57:35814) 2024-04-24T01:48:41.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.206+0000 7ff2c18b8640 1 -- 172.21.15.57:0/1362183427 learned_addr learned my addr 172.21.15.57:0/1362183427 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T01:48:41.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.206+0000 7ff2c20b9640 1 --1- 172.21.15.57:0/1362183427 >> v1:172.21.15.57:6789/0 conn(0x7ff2bc09e710 0x7ff2bc0a0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59026/0 (socket says 172.21.15.57:59026) 2024-04-24T01:48:41.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.206+0000 7f71c7fff640 1 -- 172.21.15.57:0/4077581948 >> v1:172.21.15.57:6789/0 conn(0x7f71c8132c40 legacy=0x7f71c8133050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.206+0000 7f71c7fff640 1 -- 172.21.15.57:0/4077581948 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c81326d0 con 0x7f71c81359e0 2024-04-24T01:48:41.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.206+0000 7ff2c18b8640 1 -- 172.21.15.57:0/1362183427 >> v1:172.21.15.57:6789/0 conn(0x7ff2bc09e710 legacy=0x7ff2bc0a0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.206+0000 7f71c7fff640 1 --2- 172.21.15.57:0/4077581948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71c81359e0 0x7f71c8137e00 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c9541072386eec server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.206+0000 7ff2c18b8640 1 -- 172.21.15.57:0/1362183427 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2bc0a0730 con 0x7ff2bc137c50 2024-04-24T01:48:41.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.206+0000 7ff2c18b8640 1 --2- 172.21.15.57:0/1362183427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2bc137c50 0x7ff2bc13a070 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3cadda82813bfc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.206+0000 7f71c77fe640 1 -- 172.21.15.57:0/4077581948 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f71b4009d90 con 0x7f71c81359e0 2024-04-24T01:48:41.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.207+0000 7f71c77fe640 1 -- 172.21.15.57:0/4077581948 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f71b400e230 con 0x7f71c81359e0 2024-04-24T01:48:41.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.207+0000 7f71c77fe640 1 -- 172.21.15.57:0/4077581948 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f71b400e4d0 con 0x7f71c81359e0 2024-04-24T01:48:41.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.207+0000 7ff2c10b7640 1 -- 172.21.15.57:0/1362183427 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff2ac009e40 con 0x7ff2bc137c50 2024-04-24T01:48:41.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.207+0000 7ff2c10b7640 1 -- 172.21.15.57:0/1362183427 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff2ac00e230 con 0x7ff2bc137c50 2024-04-24T01:48:41.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.207+0000 7ff2c10b7640 1 -- 172.21.15.57:0/1362183427 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff2ac00e4d0 con 0x7ff2bc137c50 2024-04-24T01:48:41.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.207+0000 7f909766d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9090071a60 0x7f90901381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.207+0000 7f9095409640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9090070f40 0x7f9090071350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59042/0 (socket says 172.21.15.57:59042) 2024-04-24T01:48:41.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.207+0000 7f909766d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9090072ff0 con 0x7f9090070f40 2024-04-24T01:48:41.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.207+0000 7f909766d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f9090072ce0 con 0x7f9090071a60 2024-04-24T01:48:41.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.207+0000 7f2f76ead640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2f700a0e00 0x7f2f70139c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.207+0000 7f2f74c49640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2f7009f630 0x7f2f700a06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59050/0 (socket says 172.21.15.57:59050) 2024-04-24T01:48:41.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.207+0000 7f9095409640 1 -- 172.21.15.57:0/4116552114 learned_addr learned my addr 172.21.15.57:0/4116552114 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T01:48:41.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.207+0000 7f9094c08640 1 --2- 172.21.15.57:0/4116552114 >> v2:172.21.15.57:3300/0 conn(0x7f9090071a60 0x7f90901381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:41.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.207+0000 7f2f74c49640 1 -- 172.21.15.57:0/3034882625 learned_addr learned my addr 172.21.15.57:0/3034882625 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T01:48:41.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.207+0000 7f2f76ead640 1 -- 172.21.15.57:0/3034882625 --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f7009fa40 con 0x7f2f7009f630 2024-04-24T01:48:41.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.207+0000 7f2f76ead640 1 -- 172.21.15.57:0/3034882625 --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f2f700a1210 con 0x7f2f700a0e00 2024-04-24T01:48:41.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.207+0000 7f2f6ffff640 1 --2- 172.21.15.57:0/3034882625 >> v2:172.21.15.57:3300/0 conn(0x7f2f700a0e00 0x7f2f70139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:41.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.207+0000 7f9094c08640 1 -- 172.21.15.57:0/4116552114 >> v1:172.21.15.57:6789/0 conn(0x7f9090070f40 legacy=0x7f9090071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.207+0000 7f9094c08640 1 -- 172.21.15.57:0/4116552114 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9090073ab0 con 0x7f9090071a60 2024-04-24T01:48:41.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.207+0000 7f2f6f7fe640 1 -- 172.21.15.57:0/3034882625 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2279415733 0 0) 0x7f2f7009fa40 con 0x7f2f7009f630 2024-04-24T01:48:41.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.208+0000 7f2f6f7fe640 1 -- 172.21.15.57:0/3034882625 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f60003580 con 0x7f2f7009f630 2024-04-24T01:48:41.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.208+0000 7f71cf06d640 1 -- 172.21.15.57:0/4077581948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71c81359e0 msgr2=0x7f71c8137e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.208+0000 7f71cf06d640 1 --2- 172.21.15.57:0/4077581948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71c81359e0 0x7f71c8137e00 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.208+0000 7f2f6ffff640 1 -- 172.21.15.57:0/3034882625 >> v1:172.21.15.57:6789/0 conn(0x7f2f7009f630 legacy=0x7f2f700a06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.208+0000 7f2f6ffff640 1 -- 172.21.15.57:0/3034882625 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f7009ddd0 con 0x7f2f700a0e00 2024-04-24T01:48:41.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.208+0000 7f71cf06d640 1 -- 172.21.15.57:0/4077581948 shutdown_connections 2024-04-24T01:48:41.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.208+0000 7f71cf06d640 1 --2- 172.21.15.57:0/4077581948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71c81359e0 0x7f71c8137e00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.208+0000 7f71cf06d640 1 -- 172.21.15.57:0/4077581948 >> 172.21.15.57:0/4077581948 conn(0x7f71c80a19a0 msgr2=0x7f71c80a1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:41.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.208+0000 7f9094c08640 1 --2- 172.21.15.57:0/4116552114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9090071a60 0x7f90901381c0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a44e0a7f704430 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.208+0000 7f2f6ffff640 1 --2- 172.21.15.57:0/3034882625 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f700a0e00 0x7f2f70139c60 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=358c45a2422f02b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.208+0000 7f71cf06d640 1 -- 172.21.15.57:0/4077581948 shutdown_connections 2024-04-24T01:48:41.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.208+0000 7f71cf06d640 1 -- 172.21.15.57:0/4077581948 wait complete. 2024-04-24T01:48:41.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.208+0000 7ff2c431d640 1 -- 172.21.15.57:0/1362183427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2bc137c50 msgr2=0x7ff2bc13a070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.208+0000 7ff2c431d640 1 --2- 172.21.15.57:0/1362183427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2bc137c50 0x7ff2bc13a070 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.208+0000 7f2f6f7fe640 1 -- 172.21.15.57:0/3034882625 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2f5c009d90 con 0x7f2f700a0e00 2024-04-24T01:48:41.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.208+0000 7f2f6f7fe640 1 -- 172.21.15.57:0/3034882625 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2f5c00e230 con 0x7f2f700a0e00 2024-04-24T01:48:41.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.208+0000 7f2f6f7fe640 1 -- 172.21.15.57:0/3034882625 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2f5c00e4d0 con 0x7f2f700a0e00 2024-04-24T01:48:41.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.208+0000 7f71cf06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:41.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.208+0000 7ff2c431d640 1 -- 172.21.15.57:0/1362183427 shutdown_connections 2024-04-24T01:48:41.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.208+0000 7ff2c431d640 1 --2- 172.21.15.57:0/1362183427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2bc137c50 0x7ff2bc13a070 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.208+0000 7ff2c431d640 1 -- 172.21.15.57:0/1362183427 >> 172.21.15.57:0/1362183427 conn(0x7ff2bc0a3af0 msgr2=0x7ff2bc0a3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:41.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.208+0000 7f9087fff640 1 -- 172.21.15.57:0/4116552114 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9080009d90 con 0x7f9090071a60 2024-04-24T01:48:41.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.208+0000 7f9087fff640 1 -- 172.21.15.57:0/4116552114 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f908000e230 con 0x7f9090071a60 2024-04-24T01:48:41.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.208+0000 7ff2c431d640 1 -- 172.21.15.57:0/1362183427 shutdown_connections 2024-04-24T01:48:41.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.208+0000 7f9087fff640 1 -- 172.21.15.57:0/4116552114 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f908000e4d0 con 0x7f9090071a60 2024-04-24T01:48:41.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.208+0000 7ff2c431d640 1 -- 172.21.15.57:0/1362183427 wait complete. 2024-04-24T01:48:41.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.209+0000 7ff2c431d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:41.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.210+0000 7f909766d640 1 -- 172.21.15.57:0/4116552114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9090071a60 msgr2=0x7f90901381c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.210+0000 7f909766d640 1 --2- 172.21.15.57:0/4116552114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9090071a60 0x7f90901381c0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.210+0000 7f2f76ead640 1 -- 172.21.15.57:0/3034882625 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f700a0e00 msgr2=0x7f2f70139c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.210+0000 7f2f76ead640 1 --2- 172.21.15.57:0/3034882625 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f700a0e00 0x7f2f70139c60 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.210+0000 7f2f76ead640 1 -- 172.21.15.57:0/3034882625 shutdown_connections 2024-04-24T01:48:41.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.210+0000 7f2f76ead640 1 --2- 172.21.15.57:0/3034882625 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f700a0e00 0x7f2f70139c60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.210+0000 7f2f76ead640 1 -- 172.21.15.57:0/3034882625 >> 172.21.15.57:0/3034882625 conn(0x7f2f7006be40 msgr2=0x7f2f7006c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:41.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.210+0000 7f2f76ead640 1 -- 172.21.15.57:0/3034882625 shutdown_connections 2024-04-24T01:48:41.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.210+0000 7f2f76ead640 1 -- 172.21.15.57:0/3034882625 wait complete. 2024-04-24T01:48:41.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.210+0000 7f909766d640 1 -- 172.21.15.57:0/4116552114 shutdown_connections 2024-04-24T01:48:41.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.210+0000 7f909766d640 1 --2- 172.21.15.57:0/4116552114 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9090071a60 0x7f90901381c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.210+0000 7f909766d640 1 -- 172.21.15.57:0/4116552114 >> 172.21.15.57:0/4116552114 conn(0x7f90900a0d10 msgr2=0x7f90900a1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:41.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.210+0000 7f71cf06d640 1 Processor -- start 2024-04-24T01:48:41.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.210+0000 7f71cf06d640 1 -- start start 2024-04-24T01:48:41.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.210+0000 7f909766d640 1 -- 172.21.15.57:0/4116552114 shutdown_connections 2024-04-24T01:48:41.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.210+0000 7f909766d640 1 -- 172.21.15.57:0/4116552114 wait complete. 2024-04-24T01:48:41.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.210+0000 7ff2c431d640 1 Processor -- start 2024-04-24T01:48:41.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.211+0000 7f909766d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:41.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.210+0000 7f2f76ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:41.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.211+0000 7ff2c431d640 1 -- start start 2024-04-24T01:48:41.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.212+0000 7f71cf06d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71c8132c40 0x7f71c811be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.212+0000 7ff2c431d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2bc137c50 0x7ff2bc11f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.212+0000 7f71cf06d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f71c811d0b0 con 0x7f71c8132c40 2024-04-24T01:48:41.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.212+0000 7ff2c431d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff2bc11efd0 con 0x7ff2bc137c50 2024-04-24T01:48:41.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.212+0000 7ff2c20b9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2bc137c50 0x7ff2bc11f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:41.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.212+0000 7f71cce09640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71c8132c40 0x7f71c811be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:41.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.212+0000 7f71cce09640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71c8132c40 0x7f71c811be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35864/0 (socket says 172.21.15.57:35864) 2024-04-24T01:48:41.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.212+0000 7f71cce09640 1 -- 172.21.15.57:0/2489770515 learned_addr learned my addr 172.21.15.57:0/2489770515 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T01:48:41.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.212+0000 7ff2c20b9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2bc137c50 0x7ff2bc11f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35868/0 (socket says 172.21.15.57:35868) 2024-04-24T01:48:41.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.212+0000 7ff2c20b9640 1 -- 172.21.15.57:0/558179799 learned_addr learned my addr 172.21.15.57:0/558179799 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T01:48:41.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.213+0000 7f71cce09640 1 -- 172.21.15.57:0/2489770515 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71c811ea30 con 0x7f71c8132c40 2024-04-24T01:48:41.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.213+0000 7f71cce09640 1 --2- 172.21.15.57:0/2489770515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71c8132c40 0x7f71c811be90 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.213+0000 7ff2c20b9640 1 -- 172.21.15.57:0/558179799 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2bc120fb0 con 0x7ff2bc137c50 2024-04-24T01:48:41.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.213+0000 7f2f76ead640 1 Processor -- start 2024-04-24T01:48:41.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.213+0000 7f71c57fa640 1 -- 172.21.15.57:0/2489770515 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f71bc005a60 con 0x7f71c8132c40 2024-04-24T01:48:41.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.213+0000 7f71c57fa640 1 -- 172.21.15.57:0/2489770515 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f71bc005bc0 con 0x7f71c8132c40 2024-04-24T01:48:41.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.213+0000 7f71c57fa640 1 -- 172.21.15.57:0/2489770515 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f71bc005e60 con 0x7f71c8132c40 2024-04-24T01:48:41.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.213+0000 7f2f76ead640 1 -- start start 2024-04-24T01:48:41.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.213+0000 7f71cf06d640 1 -- 172.21.15.57:0/2489770515 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71c811ec90 con 0x7f71c8132c40 2024-04-24T01:48:41.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.213+0000 7ff2c20b9640 1 --2- 172.21.15.57:0/558179799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2bc137c50 0x7ff2bc11f520 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.213+0000 7f909766d640 1 Processor -- start 2024-04-24T01:48:41.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.213+0000 7f909766d640 1 -- start start 2024-04-24T01:48:41.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.213+0000 7ff2b2ffd640 1 -- 172.21.15.57:0/558179799 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff2b80059a0 con 0x7ff2bc137c50 2024-04-24T01:48:41.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.213+0000 7ff2b2ffd640 1 -- 172.21.15.57:0/558179799 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff2b8005b00 con 0x7ff2bc137c50 2024-04-24T01:48:41.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.214+0000 7ff2b2ffd640 1 -- 172.21.15.57:0/558179799 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff2b8005da0 con 0x7ff2bc137c50 2024-04-24T01:48:41.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.213+0000 7f71cf06d640 1 -- 172.21.15.57:0/2489770515 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71c811f420 con 0x7f71c8132c40 2024-04-24T01:48:41.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.214+0000 7ff2c431d640 1 -- 172.21.15.57:0/558179799 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2bc1206d0 con 0x7ff2bc137c50 2024-04-24T01:48:41.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.214+0000 7f71cf06d640 1 -- 172.21.15.57:0/2489770515 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f71c8134950 con 0x7f71c8132c40 2024-04-24T01:48:41.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.214+0000 7ff2c431d640 1 -- 172.21.15.57:0/558179799 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2bc1212d0 con 0x7ff2bc137c50 2024-04-24T01:48:41.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.215+0000 7f71c57fa640 1 -- 172.21.15.57:0/2489770515 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f71bc00c790 con 0x7f71c8132c40 2024-04-24T01:48:41.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.215+0000 7f71c57fa640 1 --2- 172.21.15.57:0/2489770515 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f71ac03cd40 0x7f71ac03f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.215+0000 7f71c57fa640 1 -- 172.21.15.57:0/2489770515 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7f71bc048130 con 0x7f71c8132c40 2024-04-24T01:48:41.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.215+0000 7f71c57fa640 1 --2- 172.21.15.57:0/2489770515 >> v2:172.21.15.57:6801/2208289758 conn(0x7f71ac041d40 0x7f71ac0441d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.215+0000 7f71c57fa640 1 -- 172.21.15.57:0/2489770515 --> v2:172.21.15.57:6801/2208289758 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f71ac044860 con 0x7f71ac041d40 2024-04-24T01:48:41.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.215+0000 7f71c57fa640 1 -- 172.21.15.57:0/2489770515 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (crc 0 0 0) 0x7f71bc00d4d0 con 0x7f71c8132c40 2024-04-24T01:48:41.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.215+0000 7f71c7fff640 1 --2- 172.21.15.57:0/2489770515 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f71ac03cd40 0x7f71ac03f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:41.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.216+0000 7ff2c431d640 1 -- 172.21.15.57:0/558179799 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff2bc11edd0 con 0x7ff2bc137c50 2024-04-24T01:48:41.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.216+0000 7f2f76ead640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f7009f630 0x7f2f701211d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.216+0000 7ff2b2ffd640 1 -- 172.21.15.57:0/558179799 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7ff2b80070b0 con 0x7ff2bc137c50 2024-04-24T01:48:41.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.216+0000 7f2f76ead640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f2f70124310 con 0x7f2f7009f630 2024-04-24T01:48:41.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.216+0000 7f2f74c49640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f7009f630 0x7f2f701211d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:41.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.216+0000 7f2f74c49640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f7009f630 0x7f2f701211d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35876/0 (socket says 172.21.15.57:35876) 2024-04-24T01:48:41.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.216+0000 7f2f74c49640 1 -- 172.21.15.57:0/378005574 learned_addr learned my addr 172.21.15.57:0/378005574 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T01:48:41.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.216+0000 7ff2b2ffd640 1 --2- 172.21.15.57:0/558179799 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7ff2a0038980 0x7ff2a003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.216+0000 7ff2b2ffd640 1 -- 172.21.15.57:0/558179799 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7ff2b8048150 con 0x7ff2bc137c50 2024-04-24T01:48:41.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.216+0000 7f71cd60a640 1 --2- 172.21.15.57:0/2489770515 >> v2:172.21.15.57:6801/2208289758 conn(0x7f71ac041d40 0x7f71ac0441d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T01:48:41.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.216+0000 7f909766d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9090070f40 0x7f9090136fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.216+0000 7f909766d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9090096f50 con 0x7f9090070f40 2024-04-24T01:48:41.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.216+0000 7ff2b2ffd640 1 --2- 172.21.15.57:0/558179799 >> v2:172.21.15.84:6808/91137974 conn(0x7ff2a003d980 0x7ff2a003fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.216+0000 7ff2b2ffd640 1 -- 172.21.15.57:0/558179799 --> v2:172.21.15.84:6808/91137974 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff2a00404a0 con 0x7ff2a003d980 2024-04-24T01:48:41.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.216+0000 7ff2c18b8640 1 --2- 172.21.15.57:0/558179799 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7ff2a0038980 0x7ff2a003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:41.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.216+0000 7ff2b2ffd640 1 -- 172.21.15.57:0/558179799 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (crc 0 0 0) 0x7ff2b804a640 con 0x7ff2bc137c50 2024-04-24T01:48:41.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.216+0000 7f71c7fff640 1 --2- 172.21.15.57:0/2489770515 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f71ac03cd40 0x7f71ac03f250 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.217+0000 7f9095409640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9090070f40 0x7f9090136fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:41.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.217+0000 7f2f74c49640 1 -- 172.21.15.57:0/378005574 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f7006cdd0 con 0x7f2f7009f630 2024-04-24T01:48:41.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.217+0000 7f9095409640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9090070f40 0x7f9090136fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35878/0 (socket says 172.21.15.57:35878) 2024-04-24T01:48:41.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.217+0000 7f9095409640 1 -- 172.21.15.57:0/353903564 learned_addr learned my addr 172.21.15.57:0/353903564 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T01:48:41.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.217+0000 7f2f74c49640 1 --2- 172.21.15.57:0/378005574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f7009f630 0x7f2f701211d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.217+0000 7ff2c18b8640 1 --2- 172.21.15.57:0/558179799 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7ff2a0038980 0x7ff2a003ae90 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.217+0000 7f2f6d7fa640 1 -- 172.21.15.57:0/378005574 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2f64005a60 con 0x7f2f7009f630 2024-04-24T01:48:41.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.217+0000 7f9095409640 1 -- 172.21.15.57:0/353903564 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9090094aa0 con 0x7f9090070f40 2024-04-24T01:48:41.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.217+0000 7f2f6d7fa640 1 -- 172.21.15.57:0/378005574 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2f64005bc0 con 0x7f2f7009f630 2024-04-24T01:48:41.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.217+0000 7f2f76ead640 1 -- 172.21.15.57:0/378005574 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f70125240 con 0x7f2f7009f630 2024-04-24T01:48:41.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.217+0000 7ff2c28ba640 1 --2- 172.21.15.57:0/558179799 >> v2:172.21.15.84:6808/91137974 conn(0x7ff2a003d980 0x7ff2a003fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T01:48:41.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.217+0000 7f9095409640 1 --2- 172.21.15.57:0/353903564 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9090070f40 0x7f9090136fc0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.217+0000 7f2f6d7fa640 1 -- 172.21.15.57:0/378005574 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2f64005e60 con 0x7f2f7009f630 2024-04-24T01:48:41.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.218+0000 7f2f76ead640 1 -- 172.21.15.57:0/378005574 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f70123d50 con 0x7f2f7009f630 2024-04-24T01:48:41.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.218+0000 7f9085ffb640 1 -- 172.21.15.57:0/353903564 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f908c005a60 con 0x7f9090070f40 2024-04-24T01:48:41.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.218+0000 7f9085ffb640 1 -- 172.21.15.57:0/353903564 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f908c005bc0 con 0x7f9090070f40 2024-04-24T01:48:41.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.218+0000 7f9085ffb640 1 -- 172.21.15.57:0/353903564 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f908c005e60 con 0x7f9090070f40 2024-04-24T01:48:41.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.218+0000 7f909766d640 1 -- 172.21.15.57:0/353903564 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9090073ed0 con 0x7f9090070f40 2024-04-24T01:48:41.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.219+0000 7f909766d640 1 -- 172.21.15.57:0/353903564 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9090138270 con 0x7f9090070f40 2024-04-24T01:48:41.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.219+0000 7f2f76ead640 1 -- 172.21.15.57:0/378005574 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2f700a3510 con 0x7f2f7009f630 2024-04-24T01:48:41.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.219+0000 7f2f6d7fa640 1 -- 172.21.15.57:0/378005574 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f2f6400c7a0 con 0x7f2f7009f630 2024-04-24T01:48:41.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.219+0000 7f2f6d7fa640 1 --2- 172.21.15.57:0/378005574 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f2f54038980 0x7f2f5403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.219+0000 7f909766d640 1 -- 172.21.15.57:0/353903564 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9090098910 con 0x7f9090070f40 2024-04-24T01:48:41.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.219+0000 7f2f6d7fa640 1 -- 172.21.15.57:0/378005574 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7f2f640481a0 con 0x7f2f7009f630 2024-04-24T01:48:41.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.219+0000 7f2f6d7fa640 1 --2- 172.21.15.57:0/378005574 >> v2:172.21.15.84:6805/1003835807 conn(0x7f2f5403d980 0x7f2f5403fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.219+0000 7f2f6d7fa640 1 -- 172.21.15.57:0/378005574 --> v2:172.21.15.84:6805/1003835807 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2f540404a0 con 0x7f2f5403d980 2024-04-24T01:48:41.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.220+0000 7f2f6d7fa640 1 -- 172.21.15.57:0/378005574 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (crc 0 0 0) 0x7f2f6404a690 con 0x7f2f7009f630 2024-04-24T01:48:41.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.220+0000 7f2f6ffff640 1 --2- 172.21.15.57:0/378005574 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f2f54038980 0x7f2f5403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:41.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.220+0000 7f9085ffb640 1 -- 172.21.15.57:0/353903564 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f908c0070b0 con 0x7f9090070f40 2024-04-24T01:48:41.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.220+0000 7f9085ffb640 1 --2- 172.21.15.57:0/353903564 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f90740389d0 0x7f907403aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.220+0000 7f9085ffb640 1 -- 172.21.15.57:0/353903564 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7f908c047e90 con 0x7f9090070f40 2024-04-24T01:48:41.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.220+0000 7f2f6ffff640 1 --2- 172.21.15.57:0/378005574 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f2f54038980 0x7f2f5403ae90 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.220+0000 7f9085ffb640 1 --2- 172.21.15.57:0/353903564 >> v2:172.21.15.57:6805/2600611357 conn(0x7f907403d9d0 0x7f907403fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.220+0000 7f9085ffb640 1 -- 172.21.15.57:0/353903564 --> v2:172.21.15.57:6805/2600611357 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f90740404f0 con 0x7f907403d9d0 2024-04-24T01:48:41.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.220+0000 7f9085ffb640 1 -- 172.21.15.57:0/353903564 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (crc 0 0 0) 0x7f908c04a300 con 0x7f9090070f40 2024-04-24T01:48:41.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.220+0000 7f9094c08640 1 --2- 172.21.15.57:0/353903564 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f90740389d0 0x7f907403aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:41.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.221+0000 7f2f7544a640 1 --2- 172.21.15.57:0/378005574 >> v2:172.21.15.84:6805/1003835807 conn(0x7f2f5403d980 0x7f2f5403fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T01:48:41.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.221+0000 7ff2c28ba640 1 --2- 172.21.15.57:0/558179799 >> v2:172.21.15.84:6808/91137974 conn(0x7ff2a003d980 0x7ff2a003fe10 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.221+0000 7f9095c0a640 1 --2- 172.21.15.57:0/353903564 >> v2:172.21.15.57:6805/2600611357 conn(0x7f907403d9d0 0x7f907403fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T01:48:41.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.222+0000 7f71cd60a640 1 --2- 172.21.15.57:0/2489770515 >> v2:172.21.15.57:6801/2208289758 conn(0x7f71ac041d40 0x7f71ac0441d0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.222+0000 7f9094c08640 1 --2- 172.21.15.57:0/353903564 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f90740389d0 0x7f907403aee0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.222+0000 7ff2b2ffd640 1 -- 172.21.15.57:0/558179799 <== osd.3 v2:172.21.15.84:6808/91137974 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7ff2a00404a0 con 0x7ff2a003d980 2024-04-24T01:48:41.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.224+0000 7f71c57fa640 1 -- 172.21.15.57:0/2489770515 <== osd.0 v2:172.21.15.57:6801/2208289758 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7f71ac044860 con 0x7f71ac041d40 2024-04-24T01:48:41.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.225+0000 7f2f7544a640 1 --2- 172.21.15.57:0/378005574 >> v2:172.21.15.84:6805/1003835807 conn(0x7f2f5403d980 0x7f2f5403fe10 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.226+0000 7f9095c0a640 1 --2- 172.21.15.57:0/353903564 >> v2:172.21.15.57:6805/2600611357 conn(0x7f907403d9d0 0x7f907403fe60 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.226+0000 7ff2c431d640 1 -- 172.21.15.57:0/558179799 --> v2:172.21.15.84:6808/91137974 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff2bc122ce0 con 0x7ff2a003d980 2024-04-24T01:48:41.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.227+0000 7f2f6d7fa640 1 -- 172.21.15.57:0/378005574 <== osd.2 v2:172.21.15.84:6805/1003835807 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7f2f540404a0 con 0x7f2f5403d980 2024-04-24T01:48:41.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.228+0000 7f9085ffb640 1 -- 172.21.15.57:0/353903564 <== osd.1 v2:172.21.15.57:6805/2600611357 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7f90740404f0 con 0x7f907403d9d0 2024-04-24T01:48:41.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.228+0000 7ff2b2ffd640 1 -- 172.21.15.57:0/558179799 <== osd.3 v2:172.21.15.84:6808/91137974 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff2b400a820 con 0x7ff2a003d980 2024-04-24T01:48:41.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.228+0000 7ff2c431d640 1 -- 172.21.15.57:0/558179799 >> v2:172.21.15.84:6808/91137974 conn(0x7ff2a003d980 msgr2=0x7ff2a003fe10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.228+0000 7ff2c431d640 1 --2- 172.21.15.57:0/558179799 >> v2:172.21.15.84:6808/91137974 conn(0x7ff2a003d980 0x7ff2a003fe10 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.228+0000 7ff2c431d640 1 -- 172.21.15.57:0/558179799 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7ff2a0038980 msgr2=0x7ff2a003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.228+0000 7ff2c431d640 1 --2- 172.21.15.57:0/558179799 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7ff2a0038980 0x7ff2a003ae90 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.228+0000 7ff2c431d640 1 -- 172.21.15.57:0/558179799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2bc137c50 msgr2=0x7ff2bc11f520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.228+0000 7ff2c431d640 1 --2- 172.21.15.57:0/558179799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2bc137c50 0x7ff2bc11f520 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.228+0000 7ff2c431d640 1 -- 172.21.15.57:0/558179799 shutdown_connections 2024-04-24T01:48:41.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.228+0000 7ff2c431d640 1 --2- 172.21.15.57:0/558179799 >> v2:172.21.15.84:6808/91137974 conn(0x7ff2a003d980 0x7ff2a003fe10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.228+0000 7ff2c431d640 1 --2- 172.21.15.57:0/558179799 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7ff2a0038980 0x7ff2a003ae90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.228+0000 7ff2c431d640 1 --2- 172.21.15.57:0/558179799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff2bc137c50 0x7ff2bc11f520 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.228+0000 7ff2c431d640 1 -- 172.21.15.57:0/558179799 >> 172.21.15.57:0/558179799 conn(0x7ff2bc0a3af0 msgr2=0x7ff2bc0a1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:41.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.229+0000 7ff2c431d640 1 -- 172.21.15.57:0/558179799 shutdown_connections 2024-04-24T01:48:41.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.229+0000 7ff2c431d640 1 -- 172.21.15.57:0/558179799 wait complete. 2024-04-24T01:48:41.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.229+0000 7f71cf06d640 1 -- 172.21.15.57:0/2489770515 --> v2:172.21.15.57:6801/2208289758 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f71c8120100 con 0x7f71ac041d40 2024-04-24T01:48:41.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.231+0000 7f71c57fa640 1 -- 172.21.15.57:0/2489770515 <== osd.0 v2:172.21.15.57:6801/2208289758 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f71c000a820 con 0x7f71ac041d40 2024-04-24T01:48:41.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.231+0000 7f71cf06d640 1 -- 172.21.15.57:0/2489770515 >> v2:172.21.15.57:6801/2208289758 conn(0x7f71ac041d40 msgr2=0x7f71ac0441d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.231+0000 7f71cf06d640 1 --2- 172.21.15.57:0/2489770515 >> v2:172.21.15.57:6801/2208289758 conn(0x7f71ac041d40 0x7f71ac0441d0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.232+0000 7f71cf06d640 1 -- 172.21.15.57:0/2489770515 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f71ac03cd40 msgr2=0x7f71ac03f250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.232+0000 7f71cf06d640 1 --2- 172.21.15.57:0/2489770515 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f71ac03cd40 0x7f71ac03f250 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.232+0000 7f71cf06d640 1 -- 172.21.15.57:0/2489770515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71c8132c40 msgr2=0x7f71c811be90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.232+0000 7f71cf06d640 1 --2- 172.21.15.57:0/2489770515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71c8132c40 0x7f71c811be90 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.232+0000 7f71cf06d640 1 -- 172.21.15.57:0/2489770515 shutdown_connections 2024-04-24T01:48:41.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.232+0000 7f71cf06d640 1 --2- 172.21.15.57:0/2489770515 >> v2:172.21.15.57:6801/2208289758 conn(0x7f71ac041d40 0x7f71ac0441d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.232+0000 7f71cf06d640 1 --2- 172.21.15.57:0/2489770515 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f71ac03cd40 0x7f71ac03f250 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.232+0000 7f909766d640 1 -- 172.21.15.57:0/353903564 --> v2:172.21.15.57:6805/2600611357 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9090073ed0 con 0x7f907403d9d0 2024-04-24T01:48:41.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.232+0000 7f71cf06d640 1 --2- 172.21.15.57:0/2489770515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f71c8132c40 0x7f71c811be90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.232+0000 7f71cf06d640 1 -- 172.21.15.57:0/2489770515 >> 172.21.15.57:0/2489770515 conn(0x7f71c80a19a0 msgr2=0x7f71c81bab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:41.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.232+0000 7f71cf06d640 1 -- 172.21.15.57:0/2489770515 shutdown_connections 2024-04-24T01:48:41.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.232+0000 7f2f76ead640 1 -- 172.21.15.57:0/378005574 --> v2:172.21.15.84:6805/1003835807 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2f700a03e0 con 0x7f2f5403d980 2024-04-24T01:48:41.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.233+0000 7f71cf06d640 1 -- 172.21.15.57:0/2489770515 wait complete. 2024-04-24T01:48:41.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.234+0000 7f9085ffb640 1 -- 172.21.15.57:0/353903564 <== osd.1 v2:172.21.15.57:6805/2600611357 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9090073ed0 con 0x7f907403d9d0 2024-04-24T01:48:41.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.234+0000 7f909766d640 1 -- 172.21.15.57:0/353903564 >> v2:172.21.15.57:6805/2600611357 conn(0x7f907403d9d0 msgr2=0x7f907403fe60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.234+0000 7f909766d640 1 --2- 172.21.15.57:0/353903564 >> v2:172.21.15.57:6805/2600611357 conn(0x7f907403d9d0 0x7f907403fe60 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.234+0000 7f2f6d7fa640 1 -- 172.21.15.57:0/378005574 <== osd.2 v2:172.21.15.84:6805/1003835807 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2f6800a820 con 0x7f2f5403d980 2024-04-24T01:48:41.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.234+0000 7f909766d640 1 -- 172.21.15.57:0/353903564 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f90740389d0 msgr2=0x7f907403aee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.234+0000 7f909766d640 1 --2- 172.21.15.57:0/353903564 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f90740389d0 0x7f907403aee0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.234+0000 7f909766d640 1 -- 172.21.15.57:0/353903564 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9090070f40 msgr2=0x7f9090136fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.234+0000 7f909766d640 1 --2- 172.21.15.57:0/353903564 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9090070f40 0x7f9090136fc0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.235+0000 7f909766d640 1 -- 172.21.15.57:0/353903564 shutdown_connections 2024-04-24T01:48:41.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.235+0000 7f909766d640 1 --2- 172.21.15.57:0/353903564 >> v2:172.21.15.57:6805/2600611357 conn(0x7f907403d9d0 0x7f907403fe60 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.235+0000 7f909766d640 1 --2- 172.21.15.57:0/353903564 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f90740389d0 0x7f907403aee0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.235+0000 7f909766d640 1 --2- 172.21.15.57:0/353903564 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9090070f40 0x7f9090136fc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.235+0000 7f909766d640 1 -- 172.21.15.57:0/353903564 >> 172.21.15.57:0/353903564 conn(0x7f90900a0d10 msgr2=0x7f909008dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:41.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.235+0000 7f2f76ead640 1 -- 172.21.15.57:0/378005574 >> v2:172.21.15.84:6805/1003835807 conn(0x7f2f5403d980 msgr2=0x7f2f5403fe10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.235+0000 7f2f76ead640 1 --2- 172.21.15.57:0/378005574 >> v2:172.21.15.84:6805/1003835807 conn(0x7f2f5403d980 0x7f2f5403fe10 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.235+0000 7f909766d640 1 -- 172.21.15.57:0/353903564 shutdown_connections 2024-04-24T01:48:41.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.235+0000 7f2f76ead640 1 -- 172.21.15.57:0/378005574 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f2f54038980 msgr2=0x7f2f5403ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.235+0000 7f2f76ead640 1 --2- 172.21.15.57:0/378005574 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f2f54038980 0x7f2f5403ae90 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.235+0000 7f909766d640 1 -- 172.21.15.57:0/353903564 wait complete. 2024-04-24T01:48:41.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.235+0000 7f2f76ead640 1 -- 172.21.15.57:0/378005574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f7009f630 msgr2=0x7f2f701211d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.235+0000 7f2f76ead640 1 --2- 172.21.15.57:0/378005574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f7009f630 0x7f2f701211d0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.235+0000 7f2f76ead640 1 -- 172.21.15.57:0/378005574 shutdown_connections 2024-04-24T01:48:41.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.235+0000 7f2f76ead640 1 --2- 172.21.15.57:0/378005574 >> v2:172.21.15.84:6805/1003835807 conn(0x7f2f5403d980 0x7f2f5403fe10 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.235+0000 7f2f76ead640 1 --2- 172.21.15.57:0/378005574 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f2f54038980 0x7f2f5403ae90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.235+0000 7f2f76ead640 1 --2- 172.21.15.57:0/378005574 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f7009f630 0x7f2f701211d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.235+0000 7f2f76ead640 1 -- 172.21.15.57:0/378005574 >> 172.21.15.57:0/378005574 conn(0x7f2f7006be40 msgr2=0x7f2f70132740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:41.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.236+0000 7f2f76ead640 1 -- 172.21.15.57:0/378005574 shutdown_connections 2024-04-24T01:48:41.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.236+0000 7f2f76ead640 1 -- 172.21.15.57:0/378005574 wait complete. 2024-04-24T01:48:41.268 INFO:teuthology.orchestra.run.smithi057.stdout:38654705670 2024-04-24T01:48:41.269 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-24T01:48:41.270 INFO:teuthology.orchestra.run.smithi057.stdout:38654705670 2024-04-24T01:48:41.270 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-24T01:48:41.271 INFO:teuthology.orchestra.run.smithi057.stdout:38654705670 2024-04-24T01:48:41.271 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-24T01:48:41.272 INFO:teuthology.orchestra.run.smithi057.stdout:38654705670 2024-04-24T01:48:41.272 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-24T01:48:41.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.426+0000 7f3823e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:41.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.426+0000 7fb4cf26d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:41.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.426+0000 7fed38e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:41.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.426+0000 7fad94f5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:41.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.432+0000 7f3823e6d640 1 Processor -- start 2024-04-24T01:48:41.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.432+0000 7fad94f5d640 1 Processor -- start 2024-04-24T01:48:41.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.432+0000 7fed38e6d640 1 Processor -- start 2024-04-24T01:48:41.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.432+0000 7fb4cf26d640 1 Processor -- start 2024-04-24T01:48:41.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.432+0000 7fed38e6d640 1 -- start start 2024-04-24T01:48:41.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.432+0000 7fad94f5d640 1 -- start start 2024-04-24T01:48:41.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.433+0000 7f3823e6d640 1 -- start start 2024-04-24T01:48:41.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.433+0000 7fb4cf26d640 1 -- start start 2024-04-24T01:48:41.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.434+0000 7fed38e6d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fed3406ec40 0x7fed3406f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.434+0000 7fed38e6d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed34073950 con 0x7fed341315e0 2024-04-24T01:48:41.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.434+0000 7fed38e6d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fed34070130 con 0x7fed3406ec40 2024-04-24T01:48:41.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.434+0000 7fb4cf26d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb4c8134940 0x7fb4c8136d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.434+0000 7fb4cf26d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4c809dce0 con 0x7fb4c812e760 2024-04-24T01:48:41.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.434+0000 7fb4cf26d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fb4c8073b40 con 0x7fb4c8134940 2024-04-24T01:48:41.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.434+0000 7fb4cd009640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb4c812e760 0x7fb4c812eb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59066/0 (socket says 172.21.15.57:59066) 2024-04-24T01:48:41.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.434+0000 7fb4cd009640 1 -- 172.21.15.57:0/2278656660 learned_addr learned my addr 172.21.15.57:0/2278656660 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T01:48:41.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.434+0000 7fed31d9b640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fed341315e0 0x7fed341319f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59064/0 (socket says 172.21.15.57:59064) 2024-04-24T01:48:41.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.434+0000 7fed31d9b640 1 -- 172.21.15.57:0/3769063031 learned_addr learned my addr 172.21.15.57:0/3769063031 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T01:48:41.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.434+0000 7fed3259c640 1 --2- 172.21.15.57:0/3769063031 >> v2:172.21.15.57:3300/0 conn(0x7fed3406ec40 0x7fed3406f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:41.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.434+0000 7fb4cc808640 1 --2- 172.21.15.57:0/2278656660 >> v2:172.21.15.57:3300/0 conn(0x7fb4c8134940 0x7fb4c8136d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:41.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.435+0000 7fb4bffff640 1 -- 172.21.15.57:0/2278656660 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2270637917 0 0) 0x7fb4c809dce0 con 0x7fb4c812e760 2024-04-24T01:48:41.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.435+0000 7fb4bffff640 1 -- 172.21.15.57:0/2278656660 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4b4005790 con 0x7fb4c812e760 2024-04-24T01:48:41.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.435+0000 7fed3259c640 1 -- 172.21.15.57:0/3769063031 >> v1:172.21.15.57:6789/0 conn(0x7fed341315e0 legacy=0x7fed341319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.435+0000 7f3823e6d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f381c137c50 0x7f381c13a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.435+0000 7fed3259c640 1 -- 172.21.15.57:0/3769063031 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3406e7f0 con 0x7fed3406ec40 2024-04-24T01:48:41.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.435+0000 7fb4cc808640 1 -- 172.21.15.57:0/2278656660 >> v1:172.21.15.57:6789/0 conn(0x7fb4c812e760 legacy=0x7fb4c812eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.435+0000 7fb4cc808640 1 -- 172.21.15.57:0/2278656660 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4c809f860 con 0x7fb4c8134940 2024-04-24T01:48:41.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.435+0000 7f3823e6d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f381c0a0000 con 0x7f381c09e710 2024-04-24T01:48:41.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.435+0000 7f3821408640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f381c137c50 0x7f381c13a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:41.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.435+0000 7f3821408640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f381c137c50 0x7f381c13a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35912/0 (socket says 172.21.15.57:35912) 2024-04-24T01:48:41.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.435+0000 7f3821408640 1 -- 172.21.15.57:0/857362532 learned_addr learned my addr 172.21.15.57:0/857362532 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T01:48:41.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.435+0000 7fb4cc808640 1 --2- 172.21.15.57:0/2278656660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4c8134940 0x7fb4c8136d60 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b4b5b6ed3938eeb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.435+0000 7fed3259c640 1 --2- 172.21.15.57:0/3769063031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed3406ec40 0x7fed3406f050 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721ccc4138da4cbb server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.435+0000 7fad94f5d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fad9012f6d0 0x7fad9012fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.436+0000 7f3823e6d640 1 -- 172.21.15.57:0/857362532 --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f381c09e3c0 con 0x7f381c137c50 2024-04-24T01:48:41.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.435+0000 7fad94f5d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad9009cc00 con 0x7fad90132740 2024-04-24T01:48:41.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.435+0000 7fad94f5d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fad9012f2e0 con 0x7fad9012f6d0 2024-04-24T01:48:41.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.436+0000 7fb4bffff640 1 -- 172.21.15.57:0/2278656660 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb4b8009d90 con 0x7fb4c8134940 2024-04-24T01:48:41.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.436+0000 7fad8dd9b640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fad90132740 0x7fad90132b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59082/0 (socket says 172.21.15.57:59082) 2024-04-24T01:48:41.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.436+0000 7fad8dd9b640 1 -- 172.21.15.57:0/980584093 learned_addr learned my addr 172.21.15.57:0/980584093 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T01:48:41.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.436+0000 7fb4bffff640 1 -- 172.21.15.57:0/2278656660 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb4b800e230 con 0x7fb4c8134940 2024-04-24T01:48:41.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.436+0000 7fb4bffff640 1 -- 172.21.15.57:0/2278656660 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb4b800e4d0 con 0x7fb4c8134940 2024-04-24T01:48:41.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.436+0000 7fad8e59c640 1 --2- 172.21.15.57:0/980584093 >> v2:172.21.15.57:3300/0 conn(0x7fad9012f6d0 0x7fad9012fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:41.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.436+0000 7fed3159a640 1 -- 172.21.15.57:0/3769063031 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fed24009c80 con 0x7fed3406ec40 2024-04-24T01:48:41.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.436+0000 7fed3159a640 1 -- 172.21.15.57:0/3769063031 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fed24009de0 con 0x7fed3406ec40 2024-04-24T01:48:41.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.436+0000 7fed3159a640 1 -- 172.21.15.57:0/3769063031 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fed2400e360 con 0x7fed3406ec40 2024-04-24T01:48:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.436+0000 7fad8e59c640 1 -- 172.21.15.57:0/980584093 >> v1:172.21.15.57:6789/0 conn(0x7fad90132740 legacy=0x7fad90132b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.436+0000 7fad8e59c640 1 -- 172.21.15.57:0/980584093 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad9009c0c0 con 0x7fad9012f6d0 2024-04-24T01:48:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.436+0000 7f3820c07640 1 -- 172.21.15.57:0/857362532 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2401455376 0 0) 0x7f381c0a0000 con 0x7f381c09e710 2024-04-24T01:48:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.436+0000 7f3820c07640 1 -- 172.21.15.57:0/857362532 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3808003580 con 0x7f381c09e710 2024-04-24T01:48:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.436+0000 7f3821408640 1 -- 172.21.15.57:0/857362532 >> v1:172.21.15.57:6789/0 conn(0x7f381c09e710 legacy=0x7f381c0a0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.436+0000 7f3821408640 1 -- 172.21.15.57:0/857362532 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f381c0a0730 con 0x7f381c137c50 2024-04-24T01:48:41.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.437+0000 7fad8e59c640 1 --2- 172.21.15.57:0/980584093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad9012f6d0 0x7fad9012fae0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f09662367fc644f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.437+0000 7f3821408640 1 --2- 172.21.15.57:0/857362532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f381c137c50 0x7f381c13a070 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c34f1709f16abf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.437+0000 7f3820c07640 1 -- 172.21.15.57:0/857362532 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f380c009df0 con 0x7f381c137c50 2024-04-24T01:48:41.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.437+0000 7fed38e6d640 1 -- 172.21.15.57:0/3769063031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed3406ec40 msgr2=0x7fed3406f050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.437+0000 7fad8d59a640 1 -- 172.21.15.57:0/980584093 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fad80009d90 con 0x7fad9012f6d0 2024-04-24T01:48:41.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.437+0000 7f3820c07640 1 -- 172.21.15.57:0/857362532 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f380c00e230 con 0x7f381c137c50 2024-04-24T01:48:41.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.437+0000 7f3820c07640 1 -- 172.21.15.57:0/857362532 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f380c00e4d0 con 0x7f381c137c50 2024-04-24T01:48:41.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.437+0000 7fad8d59a640 1 -- 172.21.15.57:0/980584093 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fad8000e230 con 0x7fad9012f6d0 2024-04-24T01:48:41.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.437+0000 7fed38e6d640 1 --2- 172.21.15.57:0/3769063031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed3406ec40 0x7fed3406f050 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.437+0000 7fad8d59a640 1 -- 172.21.15.57:0/980584093 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fad8000e4d0 con 0x7fad9012f6d0 2024-04-24T01:48:41.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.437+0000 7fed38e6d640 1 -- 172.21.15.57:0/3769063031 shutdown_connections 2024-04-24T01:48:41.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.437+0000 7fed38e6d640 1 --2- 172.21.15.57:0/3769063031 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed3406ec40 0x7fed3406f050 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.437+0000 7fed38e6d640 1 -- 172.21.15.57:0/3769063031 >> 172.21.15.57:0/3769063031 conn(0x7fed340a0920 msgr2=0x7fed340a0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:41.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.437+0000 7fb4cf26d640 1 -- 172.21.15.57:0/2278656660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4c8134940 msgr2=0x7fb4c8136d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.437+0000 7fb4cf26d640 1 --2- 172.21.15.57:0/2278656660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4c8134940 0x7fb4c8136d60 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.437+0000 7fed38e6d640 1 -- 172.21.15.57:0/3769063031 shutdown_connections 2024-04-24T01:48:41.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.437+0000 7fed38e6d640 1 -- 172.21.15.57:0/3769063031 wait complete. 2024-04-24T01:48:41.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.437+0000 7fb4cf26d640 1 -- 172.21.15.57:0/2278656660 shutdown_connections 2024-04-24T01:48:41.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.437+0000 7fb4cf26d640 1 --2- 172.21.15.57:0/2278656660 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4c8134940 0x7fb4c8136d60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.437+0000 7fb4cf26d640 1 -- 172.21.15.57:0/2278656660 >> 172.21.15.57:0/2278656660 conn(0x7fb4c806dc70 msgr2=0x7fb4c806e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:41.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.437+0000 7fb4cf26d640 1 -- 172.21.15.57:0/2278656660 shutdown_connections 2024-04-24T01:48:41.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.437+0000 7fb4cf26d640 1 -- 172.21.15.57:0/2278656660 wait complete. 2024-04-24T01:48:41.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.437+0000 7fed38e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:41.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.438+0000 7fb4cf26d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:41.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.438+0000 7f3823e6d640 1 -- 172.21.15.57:0/857362532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f381c137c50 msgr2=0x7f381c13a070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.438+0000 7f3823e6d640 1 --2- 172.21.15.57:0/857362532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f381c137c50 0x7f381c13a070 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.438+0000 7fad94f5d640 1 -- 172.21.15.57:0/980584093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad9012f6d0 msgr2=0x7fad9012fae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.438+0000 7fad94f5d640 1 --2- 172.21.15.57:0/980584093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad9012f6d0 0x7fad9012fae0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.438+0000 7f3823e6d640 1 -- 172.21.15.57:0/857362532 shutdown_connections 2024-04-24T01:48:41.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.438+0000 7f3823e6d640 1 --2- 172.21.15.57:0/857362532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f381c137c50 0x7f381c13a070 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.438+0000 7fad94f5d640 1 -- 172.21.15.57:0/980584093 shutdown_connections 2024-04-24T01:48:41.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.438+0000 7fad94f5d640 1 --2- 172.21.15.57:0/980584093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad9012f6d0 0x7fad9012fae0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.438+0000 7f3823e6d640 1 -- 172.21.15.57:0/857362532 >> 172.21.15.57:0/857362532 conn(0x7f381c0a3af0 msgr2=0x7f381c0a3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:41.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.438+0000 7fad94f5d640 1 -- 172.21.15.57:0/980584093 >> 172.21.15.57:0/980584093 conn(0x7fad900a0920 msgr2=0x7fad900a0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:41.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.438+0000 7fad94f5d640 1 -- 172.21.15.57:0/980584093 shutdown_connections 2024-04-24T01:48:41.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.438+0000 7fad94f5d640 1 -- 172.21.15.57:0/980584093 wait complete. 2024-04-24T01:48:41.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.438+0000 7f3823e6d640 1 -- 172.21.15.57:0/857362532 shutdown_connections 2024-04-24T01:48:41.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.438+0000 7f3823e6d640 1 -- 172.21.15.57:0/857362532 wait complete. 2024-04-24T01:48:41.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.438+0000 7fad94f5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:41.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.439+0000 7f3823e6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:41.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.440+0000 7fb4cf26d640 1 Processor -- start 2024-04-24T01:48:41.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.440+0000 7fed38e6d640 1 Processor -- start 2024-04-24T01:48:41.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.441+0000 7fb4cf26d640 1 -- start start 2024-04-24T01:48:41.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.441+0000 7fed38e6d640 1 -- start start 2024-04-24T01:48:41.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.441+0000 7f3823e6d640 1 Processor -- start 2024-04-24T01:48:41.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.441+0000 7fad94f5d640 1 Processor -- start 2024-04-24T01:48:41.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.441+0000 7fad94f5d640 1 -- start start 2024-04-24T01:48:41.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.441+0000 7f3823e6d640 1 -- start start 2024-04-24T01:48:41.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.443+0000 7fb4cf26d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4c812e760 0x7fb4c81c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.443+0000 7fb4cf26d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c80733e0 con 0x7fb4c812e760 2024-04-24T01:48:41.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.443+0000 7fed38e6d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed3406ec40 0x7fed3411ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.443+0000 7fb4cd009640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4c812e760 0x7fb4c81c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:41.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.443+0000 7fed38e6d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fed3411d1a0 con 0x7fed3406ec40 2024-04-24T01:48:41.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.443+0000 7fb4cd009640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4c812e760 0x7fb4c81c5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35940/0 (socket says 172.21.15.57:35940) 2024-04-24T01:48:41.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.443+0000 7fb4cd009640 1 -- 172.21.15.57:0/3043152811 learned_addr learned my addr 172.21.15.57:0/3043152811 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T01:48:41.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.443+0000 7fed3259c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed3406ec40 0x7fed3411ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:41.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.443+0000 7fed3259c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed3406ec40 0x7fed3411ab70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35954/0 (socket says 172.21.15.57:35954) 2024-04-24T01:48:41.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.443+0000 7fed3259c640 1 -- 172.21.15.57:0/3388865948 learned_addr learned my addr 172.21.15.57:0/3388865948 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T01:48:41.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.444+0000 7fb4cd009640 1 -- 172.21.15.57:0/3043152811 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4c811dae0 con 0x7fb4c812e760 2024-04-24T01:48:41.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.444+0000 7fb4cd009640 1 --2- 172.21.15.57:0/3043152811 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4c812e760 0x7fb4c81c5770 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.444+0000 7fed3259c640 1 -- 172.21.15.57:0/3388865948 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3412ed70 con 0x7fed3406ec40 2024-04-24T01:48:41.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.444+0000 7fad94f5d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad9012f6d0 0x7fad90135740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.444+0000 7f3823e6d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f381c137c50 0x7f381c11f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.444+0000 7fad94f5d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fad90119070 con 0x7fad9012f6d0 2024-04-24T01:48:41.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.444+0000 7fed3259c640 1 --2- 172.21.15.57:0/3388865948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed3406ec40 0x7fed3411ab70 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.444+0000 7fb4bdffb640 1 -- 172.21.15.57:0/3043152811 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb4c4004b80 con 0x7fb4c812e760 2024-04-24T01:48:41.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.444+0000 7f3823e6d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f381c06cf10 con 0x7f381c137c50 2024-04-24T01:48:41.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.444+0000 7fb4cf26d640 1 -- 172.21.15.57:0/3043152811 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4c81c50a0 con 0x7fb4c812e760 2024-04-24T01:48:41.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.444+0000 7fb4bdffb640 1 -- 172.21.15.57:0/3043152811 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb4c4004ce0 con 0x7fb4c812e760 2024-04-24T01:48:41.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.444+0000 7fb4bdffb640 1 -- 172.21.15.57:0/3043152811 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb4c4007120 con 0x7fb4c812e760 2024-04-24T01:48:41.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.444+0000 7fad8e59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad9012f6d0 0x7fad90135740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:41.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.444+0000 7fad8e59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad9012f6d0 0x7fad90135740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35968/0 (socket says 172.21.15.57:35968) 2024-04-24T01:48:41.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.444+0000 7fad8e59c640 1 -- 172.21.15.57:0/3763599988 learned_addr learned my addr 172.21.15.57:0/3763599988 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T01:48:41.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.444+0000 7f3821c09640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f381c137c50 0x7f381c11f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:41.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.444+0000 7fb4cf26d640 1 -- 172.21.15.57:0/3043152811 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4c811be80 con 0x7fb4c812e760 2024-04-24T01:48:41.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.444+0000 7f3821c09640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f381c137c50 0x7f381c11f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35984/0 (socket says 172.21.15.57:35984) 2024-04-24T01:48:41.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.444+0000 7f3821c09640 1 -- 172.21.15.57:0/3874433996 learned_addr learned my addr 172.21.15.57:0/3874433996 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T01:48:41.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.445+0000 7fad8e59c640 1 -- 172.21.15.57:0/3763599988 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad901372d0 con 0x7fad9012f6d0 2024-04-24T01:48:41.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.445+0000 7fed2affd640 1 -- 172.21.15.57:0/3388865948 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fed24013610 con 0x7fed3406ec40 2024-04-24T01:48:41.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.445+0000 7fed2affd640 1 -- 172.21.15.57:0/3388865948 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fed24013770 con 0x7fed3406ec40 2024-04-24T01:48:41.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.445+0000 7fed2affd640 1 -- 172.21.15.57:0/3388865948 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fed24013a10 con 0x7fed3406ec40 2024-04-24T01:48:41.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.445+0000 7fad8e59c640 1 --2- 172.21.15.57:0/3763599988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad9012f6d0 0x7fad90135740 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.445+0000 7fed38e6d640 1 -- 172.21.15.57:0/3388865948 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed3411ec50 con 0x7fed3406ec40 2024-04-24T01:48:41.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.445+0000 7fed38e6d640 1 -- 172.21.15.57:0/3388865948 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed3411e1e0 con 0x7fed3406ec40 2024-04-24T01:48:41.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.446+0000 7f3821c09640 1 -- 172.21.15.57:0/3874433996 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f381c11f070 con 0x7f381c137c50 2024-04-24T01:48:41.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.446+0000 7fb4cf26d640 1 -- 172.21.15.57:0/3043152811 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4c8063900 con 0x7fb4c812e760 2024-04-24T01:48:41.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.446+0000 7fad7effd640 1 -- 172.21.15.57:0/3763599988 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fad80014620 con 0x7fad9012f6d0 2024-04-24T01:48:41.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.446+0000 7fb4bdffb640 1 -- 172.21.15.57:0/3043152811 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fb4c4007320 con 0x7fb4c812e760 2024-04-24T01:48:41.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.446+0000 7fad7effd640 1 -- 172.21.15.57:0/3763599988 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fad80014780 con 0x7fad9012f6d0 2024-04-24T01:48:41.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.446+0000 7fad7effd640 1 -- 172.21.15.57:0/3763599988 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fad80014a20 con 0x7fad9012f6d0 2024-04-24T01:48:41.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.446+0000 7f3821c09640 1 --2- 172.21.15.57:0/3874433996 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f381c137c50 0x7f381c11f6d0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.446+0000 7fad94f5d640 1 -- 172.21.15.57:0/3763599988 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad90074f00 con 0x7fad9012f6d0 2024-04-24T01:48:41.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.446+0000 7fb4bdffb640 1 --2- 172.21.15.57:0/3043152811 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fb4ac038930 0x7fb4ac03ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.446+0000 7fed38e6d640 1 -- 172.21.15.57:0/3388865948 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed3411eab0 con 0x7fed3406ec40 2024-04-24T01:48:41.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.446+0000 7fb4bdffb640 1 -- 172.21.15.57:0/3043152811 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7fb4c4048370 con 0x7fb4c812e760 2024-04-24T01:48:41.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.446+0000 7fad94f5d640 1 -- 172.21.15.57:0/3763599988 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad90138230 con 0x7fad9012f6d0 2024-04-24T01:48:41.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.447+0000 7fed2affd640 1 -- 172.21.15.57:0/3388865948 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fed24013b70 con 0x7fed3406ec40 2024-04-24T01:48:41.472 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.447+0000 7fb4cc808640 1 --2- 172.21.15.57:0/3043152811 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fb4ac038930 0x7fb4ac03ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:41.472 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.447+0000 7f38127fc640 1 -- 172.21.15.57:0/3874433996 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f38180051e0 con 0x7f381c137c50 2024-04-24T01:48:41.472 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.447+0000 7f38127fc640 1 -- 172.21.15.57:0/3874433996 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3818005340 con 0x7f381c137c50 2024-04-24T01:48:41.472 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.447+0000 7f38127fc640 1 -- 172.21.15.57:0/3874433996 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f381800c7c0 con 0x7f381c137c50 2024-04-24T01:48:41.472 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.447+0000 7f3823e6d640 1 -- 172.21.15.57:0/3874433996 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f381c120770 con 0x7f381c137c50 2024-04-24T01:48:41.472 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.447+0000 7f3823e6d640 1 -- 172.21.15.57:0/3874433996 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f381c11ecd0 con 0x7f381c137c50 2024-04-24T01:48:41.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.447+0000 7fed2affd640 1 --2- 172.21.15.57:0/3388865948 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fed140389d0 0x7fed1403aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.447+0000 7fed2affd640 1 -- 172.21.15.57:0/3388865948 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7fed240493b0 con 0x7fed3406ec40 2024-04-24T01:48:41.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.447+0000 7fed31d9b640 1 --2- 172.21.15.57:0/3388865948 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fed140389d0 0x7fed1403aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:41.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.448+0000 7fb4cc808640 1 --2- 172.21.15.57:0/3043152811 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fb4ac038930 0x7fb4ac03ae40 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.448+0000 7fad94f5d640 1 -- 172.21.15.57:0/3763599988 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad90119d80 con 0x7fad9012f6d0 2024-04-24T01:48:41.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.448+0000 7fed31d9b640 1 --2- 172.21.15.57:0/3388865948 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fed140389d0 0x7fed1403aee0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.448+0000 7f3823e6d640 1 -- 172.21.15.57:0/3874433996 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f381c069330 con 0x7f381c137c50 2024-04-24T01:48:41.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.453+0000 7fb4bdffb640 1 -- 172.21.15.57:0/3043152811 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fb4c400ce00 con 0x7fb4c812e760 2024-04-24T01:48:41.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.453+0000 7fad7effd640 1 -- 172.21.15.57:0/3763599988 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fad80014bd0 con 0x7fad9012f6d0 2024-04-24T01:48:41.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.453+0000 7fad7effd640 1 --2- 172.21.15.57:0/3763599988 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fad70038980 0x7fad7003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.453+0000 7fad8dd9b640 1 --2- 172.21.15.57:0/3763599988 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fad70038980 0x7fad7003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:41.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.453+0000 7f38127fc640 1 -- 172.21.15.57:0/3874433996 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f381800c920 con 0x7f381c137c50 2024-04-24T01:48:41.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.454+0000 7f38127fc640 1 --2- 172.21.15.57:0/3874433996 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f38000389d0 0x7f380003aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.454+0000 7fad8dd9b640 1 --2- 172.21.15.57:0/3763599988 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fad70038980 0x7fad7003ae90 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.454+0000 7f3821408640 1 --2- 172.21.15.57:0/3874433996 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f38000389d0 0x7f380003aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:41.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.454+0000 7f3821408640 1 --2- 172.21.15.57:0/3874433996 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f38000389d0 0x7f380003aee0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.458+0000 7fad7effd640 1 -- 172.21.15.57:0/3763599988 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7fad80019040 con 0x7fad9012f6d0 2024-04-24T01:48:41.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.458+0000 7f38127fc640 1 -- 172.21.15.57:0/3874433996 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7f3818010e30 con 0x7f381c137c50 2024-04-24T01:48:41.478 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.458+0000 7fed2affd640 1 -- 172.21.15.57:0/3388865948 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fed3411eab0 con 0x7fed3406ec40 2024-04-24T01:48:41.478 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.463+0000 7fad7effd640 1 -- 172.21.15.57:0/3763599988 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fad80012390 con 0x7fad9012f6d0 2024-04-24T01:48:41.478 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.468+0000 7f38127fc640 1 -- 172.21.15.57:0/3874433996 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f38180102a0 con 0x7f381c137c50 2024-04-24T01:48:41.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.652+0000 7fad94f5d640 1 -- 172.21.15.57:0/3763599988 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fad90136bf0 con 0x7fad9012f6d0 2024-04-24T01:48:41.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.653+0000 7fad7effd640 1 -- 172.21.15.57:0/3763599988 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7fad80010310 con 0x7fad9012f6d0 2024-04-24T01:48:41.654 INFO:teuthology.orchestra.run.smithi057.stdout:38654705670 2024-04-24T01:48:41.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.655+0000 7fad94f5d640 1 -- 172.21.15.57:0/3763599988 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fad70038980 msgr2=0x7fad7003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.655+0000 7fad94f5d640 1 --2- 172.21.15.57:0/3763599988 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fad70038980 0x7fad7003ae90 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.655+0000 7fad94f5d640 1 -- 172.21.15.57:0/3763599988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad9012f6d0 msgr2=0x7fad90135740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.655+0000 7fad94f5d640 1 --2- 172.21.15.57:0/3763599988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad9012f6d0 0x7fad90135740 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.655+0000 7fad94f5d640 1 -- 172.21.15.57:0/3763599988 shutdown_connections 2024-04-24T01:48:41.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.655+0000 7fad94f5d640 1 --2- 172.21.15.57:0/3763599988 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fad70038980 0x7fad7003ae90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.655+0000 7fad94f5d640 1 --2- 172.21.15.57:0/3763599988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fad9012f6d0 0x7fad90135740 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.655+0000 7fad94f5d640 1 -- 172.21.15.57:0/3763599988 >> 172.21.15.57:0/3763599988 conn(0x7fad900a0920 msgr2=0x7fad90138ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:41.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.655+0000 7fad94f5d640 1 -- 172.21.15.57:0/3763599988 shutdown_connections 2024-04-24T01:48:41.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.655+0000 7fad94f5d640 1 -- 172.21.15.57:0/3763599988 wait complete. 2024-04-24T01:48:41.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.660+0000 7f3823e6d640 1 -- 172.21.15.57:0/3874433996 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f381c122b50 con 0x7f381c137c50 2024-04-24T01:48:41.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.661+0000 7f38127fc640 1 -- 172.21.15.57:0/3874433996 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7f38180102a0 con 0x7f381c137c50 2024-04-24T01:48:41.662 INFO:teuthology.orchestra.run.smithi057.stdout:38654705670 2024-04-24T01:48:41.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.663+0000 7f3823e6d640 1 -- 172.21.15.57:0/3874433996 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f38000389d0 msgr2=0x7f380003aee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.663+0000 7f3823e6d640 1 --2- 172.21.15.57:0/3874433996 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f38000389d0 0x7f380003aee0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.663+0000 7f3823e6d640 1 -- 172.21.15.57:0/3874433996 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f381c137c50 msgr2=0x7f381c11f6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.663+0000 7f3823e6d640 1 --2- 172.21.15.57:0/3874433996 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f381c137c50 0x7f381c11f6d0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.663+0000 7f3823e6d640 1 -- 172.21.15.57:0/3874433996 shutdown_connections 2024-04-24T01:48:41.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.663+0000 7f3823e6d640 1 --2- 172.21.15.57:0/3874433996 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f38000389d0 0x7f380003aee0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.663+0000 7f3823e6d640 1 --2- 172.21.15.57:0/3874433996 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f381c137c50 0x7f381c11f6d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.663+0000 7f3823e6d640 1 -- 172.21.15.57:0/3874433996 >> 172.21.15.57:0/3874433996 conn(0x7f381c0a3af0 msgr2=0x7f381c0a1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:41.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.664+0000 7f3823e6d640 1 -- 172.21.15.57:0/3874433996 shutdown_connections 2024-04-24T01:48:41.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.664+0000 7f3823e6d640 1 -- 172.21.15.57:0/3874433996 wait complete. 2024-04-24T01:48:41.668 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.0 2024-04-24T01:48:41.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.667+0000 7fb4cf26d640 1 -- 172.21.15.57:0/3043152811 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb4c80737b0 con 0x7fb4c812e760 2024-04-24T01:48:41.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.667+0000 7fb4bdffb640 1 -- 172.21.15.57:0/3043152811 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7fb4c400a5d0 con 0x7fb4c812e760 2024-04-24T01:48:41.669 DEBUG:teuthology.parallel:result is None 2024-04-24T01:48:41.669 INFO:teuthology.orchestra.run.smithi057.stdout:38654705670 2024-04-24T01:48:41.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.671+0000 7fb4cf26d640 1 -- 172.21.15.57:0/3043152811 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fb4ac038930 msgr2=0x7fb4ac03ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.671+0000 7fb4cf26d640 1 --2- 172.21.15.57:0/3043152811 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fb4ac038930 0x7fb4ac03ae40 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.671+0000 7fb4cf26d640 1 -- 172.21.15.57:0/3043152811 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4c812e760 msgr2=0x7fb4c81c5770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.671+0000 7fb4cf26d640 1 --2- 172.21.15.57:0/3043152811 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4c812e760 0x7fb4c81c5770 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.671+0000 7fb4cf26d640 1 -- 172.21.15.57:0/3043152811 shutdown_connections 2024-04-24T01:48:41.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.671+0000 7fb4cf26d640 1 --2- 172.21.15.57:0/3043152811 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fb4ac038930 0x7fb4ac03ae40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.671+0000 7fb4cf26d640 1 --2- 172.21.15.57:0/3043152811 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4c812e760 0x7fb4c81c5770 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.671+0000 7fb4cf26d640 1 -- 172.21.15.57:0/3043152811 >> 172.21.15.57:0/3043152811 conn(0x7fb4c806dc70 msgr2=0x7fb4c812f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:41.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.671+0000 7fb4cf26d640 1 -- 172.21.15.57:0/3043152811 shutdown_connections 2024-04-24T01:48:41.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.671+0000 7fb4cf26d640 1 -- 172.21.15.57:0/3043152811 wait complete. 2024-04-24T01:48:41.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.673+0000 7fed38e6d640 1 -- 172.21.15.57:0/3388865948 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fed3411eab0 con 0x7fed3406ec40 2024-04-24T01:48:41.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.673+0000 7fed2affd640 1 -- 172.21.15.57:0/3388865948 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (crc 0 0 0) 0x7fed3411eab0 con 0x7fed3406ec40 2024-04-24T01:48:41.674 INFO:teuthology.orchestra.run.smithi057.stdout:38654705670 2024-04-24T01:48:41.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.675+0000 7fed38e6d640 1 -- 172.21.15.57:0/3388865948 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fed140389d0 msgr2=0x7fed1403aee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.675+0000 7fed38e6d640 1 --2- 172.21.15.57:0/3388865948 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fed140389d0 0x7fed1403aee0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.676+0000 7fed38e6d640 1 -- 172.21.15.57:0/3388865948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed3406ec40 msgr2=0x7fed3411ab70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.676+0000 7fed38e6d640 1 --2- 172.21.15.57:0/3388865948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed3406ec40 0x7fed3411ab70 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.676+0000 7fed38e6d640 1 -- 172.21.15.57:0/3388865948 shutdown_connections 2024-04-24T01:48:41.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.676+0000 7fed38e6d640 1 --2- 172.21.15.57:0/3388865948 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fed140389d0 0x7fed1403aee0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.676+0000 7fed38e6d640 1 --2- 172.21.15.57:0/3388865948 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed3406ec40 0x7fed3411ab70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.676+0000 7fed38e6d640 1 -- 172.21.15.57:0/3388865948 >> 172.21.15.57:0/3388865948 conn(0x7fed340a0920 msgr2=0x7fed341b9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:41.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.676+0000 7fed38e6d640 1 -- 172.21.15.57:0/3388865948 shutdown_connections 2024-04-24T01:48:41.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.676+0000 7fed38e6d640 1 -- 172.21.15.57:0/3388865948 wait complete. 2024-04-24T01:48:41.679 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.3 2024-04-24T01:48:41.679 DEBUG:teuthology.parallel:result is None 2024-04-24T01:48:41.685 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.2 2024-04-24T01:48:41.685 DEBUG:teuthology.parallel:result is None 2024-04-24T01:48:41.690 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.1 2024-04-24T01:48:41.690 DEBUG:teuthology.parallel:result is None 2024-04-24T01:48:41.690 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-24T01:48:41.690 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T01:48:41.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.837+0000 7f205895d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:41.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.842+0000 7f205895d640 1 Processor -- start 2024-04-24T01:48:41.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.842+0000 7f205895d640 1 -- start start 2024-04-24T01:48:41.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.843+0000 7f205895d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f20540a0e00 0x7f2054139c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.843+0000 7f205895d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20540a1210 con 0x7f205409f630 2024-04-24T01:48:41.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.843+0000 7f205895d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f205409ddd0 con 0x7f20540a0e00 2024-04-24T01:48:41.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.843+0000 7f204bfff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f20540a0e00 0x7f2054139c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:41.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.843+0000 7f205259c640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f205409f630 0x7f20540a06f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59084/0 (socket says 172.21.15.57:59084) 2024-04-24T01:48:41.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.843+0000 7f205259c640 1 -- 172.21.15.57:0/3732284290 learned_addr learned my addr 172.21.15.57:0/3732284290 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T01:48:41.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.843+0000 7f2051d9b640 1 -- 172.21.15.57:0/3732284290 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1339180100 0 0) 0x7f20540a1210 con 0x7f205409f630 2024-04-24T01:48:41.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.843+0000 7f2051d9b640 1 -- 172.21.15.57:0/3732284290 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2040003580 con 0x7f205409f630 2024-04-24T01:48:41.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.843+0000 7f204bfff640 1 -- 172.21.15.57:0/3732284290 >> v1:172.21.15.57:6789/0 conn(0x7f205409f630 legacy=0x7f20540a06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.843+0000 7f204bfff640 1 -- 172.21.15.57:0/3732284290 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f205409fa40 con 0x7f20540a0e00 2024-04-24T01:48:41.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.843+0000 7f204bfff640 1 --2- 172.21.15.57:0/3732284290 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20540a0e00 0x7f2054139c60 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a85a89f10122a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.843+0000 7f2051d9b640 1 -- 172.21.15.57:0/3732284290 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f203c009d90 con 0x7f20540a0e00 2024-04-24T01:48:41.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.843+0000 7f2051d9b640 1 -- 172.21.15.57:0/3732284290 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f203c00e230 con 0x7f20540a0e00 2024-04-24T01:48:41.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.843+0000 7f2051d9b640 1 -- 172.21.15.57:0/3732284290 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f203c00e4d0 con 0x7f20540a0e00 2024-04-24T01:48:41.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.844+0000 7f205895d640 1 -- 172.21.15.57:0/3732284290 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20540a0e00 msgr2=0x7f2054139c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:41.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.844+0000 7f205895d640 1 --2- 172.21.15.57:0/3732284290 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20540a0e00 0x7f2054139c60 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.844+0000 7f205895d640 1 -- 172.21.15.57:0/3732284290 shutdown_connections 2024-04-24T01:48:41.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.844+0000 7f205895d640 1 --2- 172.21.15.57:0/3732284290 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20540a0e00 0x7f2054139c60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:41.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.844+0000 7f205895d640 1 -- 172.21.15.57:0/3732284290 >> 172.21.15.57:0/3732284290 conn(0x7f20540a3950 msgr2=0x7f20540a3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:41.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.844+0000 7f205895d640 1 -- 172.21.15.57:0/3732284290 shutdown_connections 2024-04-24T01:48:41.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.844+0000 7f205895d640 1 -- 172.21.15.57:0/3732284290 wait complete. 2024-04-24T01:48:41.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.844+0000 7f205895d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:41.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.846+0000 7f205895d640 1 Processor -- start 2024-04-24T01:48:41.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.846+0000 7f205895d640 1 -- start start 2024-04-24T01:48:41.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.849+0000 7f205895d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f205409f630 0x7f205411ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.849+0000 7f205895d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f2054132350 con 0x7f205409f630 2024-04-24T01:48:41.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.849+0000 7f205259c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f205409f630 0x7f205411ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:41.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.849+0000 7f205259c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f205409f630 0x7f205411ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:35996/0 (socket says 172.21.15.57:35996) 2024-04-24T01:48:41.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.849+0000 7f205259c640 1 -- 172.21.15.57:0/2437031011 learned_addr learned my addr 172.21.15.57:0/2437031011 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T01:48:41.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.849+0000 7f205259c640 1 -- 172.21.15.57:0/2437031011 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2054121f50 con 0x7f205409f630 2024-04-24T01:48:41.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.849+0000 7f205259c640 1 --2- 172.21.15.57:0/2437031011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f205409f630 0x7f205411ddc0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.849+0000 7f204affd640 1 -- 172.21.15.57:0/2437031011 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2044005a60 con 0x7f205409f630 2024-04-24T01:48:41.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.849+0000 7f204affd640 1 -- 172.21.15.57:0/2437031011 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2044005bc0 con 0x7f205409f630 2024-04-24T01:48:41.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.849+0000 7f205895d640 1 -- 172.21.15.57:0/2437031011 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f205411ef50 con 0x7f205409f630 2024-04-24T01:48:41.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.849+0000 7f204affd640 1 -- 172.21.15.57:0/2437031011 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2044005e60 con 0x7f205409f630 2024-04-24T01:48:41.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.849+0000 7f205895d640 1 -- 172.21.15.57:0/2437031011 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2054121290 con 0x7f205409f630 2024-04-24T01:48:41.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.849+0000 7f204affd640 1 -- 172.21.15.57:0/2437031011 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f204400c7a0 con 0x7f205409f630 2024-04-24T01:48:41.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.849+0000 7f205895d640 1 -- 172.21.15.57:0/2437031011 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2054121740 con 0x7f205409f630 2024-04-24T01:48:41.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.850+0000 7f204affd640 1 --2- 172.21.15.57:0/2437031011 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f2034038980 0x7f203403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:41.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.850+0000 7f204affd640 1 -- 172.21.15.57:0/2437031011 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7f2044048230 con 0x7f205409f630 2024-04-24T01:48:41.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.850+0000 7f204bfff640 1 --2- 172.21.15.57:0/2437031011 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f2034038980 0x7f203403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:41.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.851+0000 7f204bfff640 1 --2- 172.21.15.57:0/2437031011 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f2034038980 0x7f203403ae90 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:41.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:41.855+0000 7f204affd640 1 -- 172.21.15.57:0/2437031011 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f204400d4d0 con 0x7f205409f630 2024-04-24T01:48:42.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.038+0000 7f205895d640 1 -- 172.21.15.57:0/2437031011 --> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f205409fd50 con 0x7f2034038980 2024-04-24T01:48:42.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.040+0000 7f204affd640 1 -- 172.21.15.57:0/2437031011 <== mgr.4101 v2:172.21.15.84:6800/1747524692 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31068 (crc 0 0 0) 0x7f203c009db0 con 0x7f2034038980 2024-04-24T01:48:42.041 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:42.041 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-24T01:48:42.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.043+0000 7f205895d640 1 -- 172.21.15.57:0/2437031011 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f2034038980 msgr2=0x7f203403ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:42.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.043+0000 7f205895d640 1 --2- 172.21.15.57:0/2437031011 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f2034038980 0x7f203403ae90 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:42.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.043+0000 7f205895d640 1 -- 172.21.15.57:0/2437031011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f205409f630 msgr2=0x7f205411ddc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:42.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.043+0000 7f205895d640 1 --2- 172.21.15.57:0/2437031011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f205409f630 0x7f205411ddc0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:42.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.043+0000 7f205895d640 1 -- 172.21.15.57:0/2437031011 shutdown_connections 2024-04-24T01:48:42.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.043+0000 7f205895d640 1 --2- 172.21.15.57:0/2437031011 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f2034038980 0x7f203403ae90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:42.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.043+0000 7f205895d640 1 --2- 172.21.15.57:0/2437031011 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f205409f630 0x7f205411ddc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:42.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.043+0000 7f205895d640 1 -- 172.21.15.57:0/2437031011 >> 172.21.15.57:0/2437031011 conn(0x7f20540a3950 msgr2=0x7f205409aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:42.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.043+0000 7f205895d640 1 -- 172.21.15.57:0/2437031011 shutdown_connections 2024-04-24T01:48:42.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.043+0000 7f205895d640 1 -- 172.21.15.57:0/2437031011 wait complete. 2024-04-24T01:48:42.053 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-04-24T01:48:41.236604+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":109776,"kb_used_data":1592,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":419320624,"statfs":{"total":429496729600,"available":429384318976,"internally_reserved":0,"allocated":1630208,"data_stored":1289732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-24T01:48:40.060552+0000","last_change":"2024-04-24T01:48:40.062414+0000","last_active":"2024-04-24T01:48:40.060552+0000","last_peered":"2024-04-24T01:48:40.060552+0000","last_clean":"2024-04-24T01:48:38.975626+0000","last_became_active":"2024-04-24T01:48:40.055629+0000","last_became_peered":"2024-04-24T01:48:40.055629+0000","last_unstale":"2024-04-24T01:48:40.060552+0000","last_undegraded":"2024-04-24T01:48:40.060552+0000","last_fullsized":"2024-04-24T01:48:40.060552+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-24T01:48:40.044646+0000","last_change":"2024-04-24T01:48:40.045311+0000","last_active":"2024-04-24T01:48:40.044646+0000","last_peered":"2024-04-24T01:48:40.044646+0000","last_clean":"2024-04-24T01:48:38.975626+0000","last_became_active":"2024-04-24T01:48:40.041551+0000","last_became_peered":"2024-04-24T01:48:40.041551+0000","last_unstale":"2024-04-24T01:48:40.044646+0000","last_undegraded":"2024-04-24T01:48:40.044646+0000","last_fullsized":"2024-04-24T01:48:40.044646+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-24T01:48:41.008289+0000","last_change":"2024-04-24T01:48:40.045108+0000","last_active":"2024-04-24T01:48:41.008289+0000","last_peered":"2024-04-24T01:48:41.008289+0000","last_clean":"2024-04-24T01:48:41.008289+0000","last_became_active":"2024-04-24T01:48:40.038574+0000","last_became_peered":"2024-04-24T01:48:40.038574+0000","last_unstale":"2024-04-24T01:48:41.008289+0000","last_undegraded":"2024-04-24T01:48:41.008289+0000","last_fullsized":"2024-04-24T01:48:41.008289+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-24T01:48:40.034298+0000","last_change":"2024-04-24T01:48:40.035237+0000","last_active":"2024-04-24T01:48:40.034298+0000","last_peered":"2024-04-24T01:48:40.034298+0000","last_clean":"2024-04-24T01:48:38.975626+0000","last_became_active":"2024-04-24T01:48:40.030062+0000","last_became_peered":"2024-04-24T01:48:40.030062+0000","last_unstale":"2024-04-24T01:48:40.034298+0000","last_undegraded":"2024-04-24T01:48:40.034298+0000","last_fullsized":"2024-04-24T01:48:40.034298+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-24T01:48:40.045341+0000","last_change":"2024-04-24T01:48:40.046631+0000","last_active":"2024-04-24T01:48:40.045341+0000","last_peered":"2024-04-24T01:48:40.045341+0000","last_clean":"2024-04-24T01:48:38.975626+0000","last_became_active":"2024-04-24T01:48:40.040843+0000","last_became_peered":"2024-04-24T01:48:40.040843+0000","last_unstale":"2024-04-24T01:48:40.045341+0000","last_undegraded":"2024-04-24T01:48:40.045341+0000","last_fullsized":"2024-04-24T01:48:40.045341+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-24T01:48:40.041903+0000","last_change":"2024-04-24T01:48:40.043159+0000","last_active":"2024-04-24T01:48:40.041903+0000","last_peered":"2024-04-24T01:48:40.041903+0000","last_clean":"2024-04-24T01:48:38.975626+0000","last_became_active":"2024-04-24T01:48:40.033297+0000","last_became_peered":"2024-04-24T01:48:40.033297+0000","last_unstale":"2024-04-24T01:48:40.041903+0000","last_undegraded":"2024-04-24T01:48:40.041903+0000","last_fullsized":"2024-04-24T01:48:40.041903+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-24T01:48:40.061745+0000","last_change":"2024-04-24T01:48:40.063620+0000","last_active":"2024-04-24T01:48:40.061745+0000","last_peered":"2024-04-24T01:48:40.061745+0000","last_clean":"2024-04-24T01:48:38.975626+0000","last_became_active":"2024-04-24T01:48:40.054792+0000","last_became_peered":"2024-04-24T01:48:40.054792+0000","last_unstale":"2024-04-24T01:48:40.061745+0000","last_undegraded":"2024-04-24T01:48:40.061745+0000","last_fullsized":"2024-04-24T01:48:40.061745+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-24T01:48:40.056730+0000","last_change":"2024-04-24T01:48:40.057853+0000","last_active":"2024-04-24T01:48:40.056730+0000","last_peered":"2024-04-24T01:48:40.056730+0000","last_clean":"2024-04-24T01:48:38.975626+0000","last_became_active":"2024-04-24T01:48:40.052084+0000","last_became_peered":"2024-04-24T01:48:40.052084+0000","last_unstale":"2024-04-24T01:48:40.056730+0000","last_undegraded":"2024-04-24T01:48:40.056730+0000","last_fullsized":"2024-04-24T01:48:40.056730+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":144,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-24T01:48:41.005093+0000","last_change":"2024-04-24T01:48:38.013745+0000","last_active":"2024-04-24T01:48:41.005093+0000","last_peered":"2024-04-24T01:48:41.005093+0000","last_clean":"2024-04-24T01:48:41.005093+0000","last_became_active":"2024-04-24T01:48:38.008438+0000","last_became_peered":"2024-04-24T01:48:38.008438+0000","last_unstale":"2024-04-24T01:48:41.005093+0000","last_undegraded":"2024-04-24T01:48:41.005093+0000","last_fullsized":"2024-04-24T01:48:41.005093+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:36.956380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:36.956380+0000","last_clean_scrub_stamp":"2024-04-24T01:48:36.956380+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27828,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829772,"statfs":{"total":107374182400,"available":107345686528,"internally_reserved":0,"allocated":704512,"data_stored":617617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27060,"kb_used_data":108,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830540,"statfs":{"total":107374182400,"available":107346472960,"internally_reserved":0,"allocated":110592,"data_stored":27249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27060,"kb_used_data":108,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830540,"statfs":{"total":107374182400,"available":107346472960,"internally_reserved":0,"allocated":110592,"data_stored":27249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27828,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829772,"statfs":{"total":107374182400,"available":107345686528,"internally_reserved":0,"allocated":704512,"data_stored":617617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T01:48:42.054 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T01:48:42.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.159+0000 7efeb242d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:42.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.164+0000 7efeb242d640 1 Processor -- start 2024-04-24T01:48:42.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.164+0000 7efeb242d640 1 -- start start 2024-04-24T01:48:42.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.166+0000 7efeb242d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efeac0a1150 0x7efeac139f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:42.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.166+0000 7efeb242d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efeac06dd10 con 0x7efeac0a0630 2024-04-24T01:48:42.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.166+0000 7efeb242d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7efeac06dab0 con 0x7efeac0a1150 2024-04-24T01:48:42.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.166+0000 7efeabfff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7efeac0a0630 0x7efeac0a0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59094/0 (socket says 172.21.15.57:59094) 2024-04-24T01:48:42.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.166+0000 7efeabfff640 1 -- 172.21.15.57:0/3254311705 learned_addr learned my addr 172.21.15.57:0/3254311705 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T01:48:42.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.166+0000 7efeab7fe640 1 --2- 172.21.15.57:0/3254311705 >> v2:172.21.15.57:3300/0 conn(0x7efeac0a1150 0x7efeac139f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:42.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.166+0000 7efeaaffd640 1 -- 172.21.15.57:0/3254311705 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 923639782 0 0) 0x7efeac06dd10 con 0x7efeac0a0630 2024-04-24T01:48:42.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.166+0000 7efeaaffd640 1 -- 172.21.15.57:0/3254311705 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe98003580 con 0x7efeac0a0630 2024-04-24T01:48:42.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.167+0000 7efeab7fe640 1 -- 172.21.15.57:0/3254311705 >> v1:172.21.15.57:6789/0 conn(0x7efeac0a0630 legacy=0x7efeac0a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:42.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.167+0000 7efeab7fe640 1 -- 172.21.15.57:0/3254311705 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeac06d7d0 con 0x7efeac0a1150 2024-04-24T01:48:42.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.167+0000 7efeab7fe640 1 --2- 172.21.15.57:0/3254311705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efeac0a1150 0x7efeac139f80 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5686ca2c7c6c95b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:42.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.167+0000 7efeaaffd640 1 -- 172.21.15.57:0/3254311705 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efe9c009d90 con 0x7efeac0a1150 2024-04-24T01:48:42.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.167+0000 7efeaaffd640 1 -- 172.21.15.57:0/3254311705 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efe9c00e230 con 0x7efeac0a1150 2024-04-24T01:48:42.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.167+0000 7efeaaffd640 1 -- 172.21.15.57:0/3254311705 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efe9c00e4d0 con 0x7efeac0a1150 2024-04-24T01:48:42.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.168+0000 7efeb242d640 1 -- 172.21.15.57:0/3254311705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efeac0a1150 msgr2=0x7efeac139f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:42.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.168+0000 7efeb242d640 1 --2- 172.21.15.57:0/3254311705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efeac0a1150 0x7efeac139f80 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:42.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.168+0000 7efeb242d640 1 -- 172.21.15.57:0/3254311705 shutdown_connections 2024-04-24T01:48:42.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.168+0000 7efeb242d640 1 --2- 172.21.15.57:0/3254311705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efeac0a1150 0x7efeac139f80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:42.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.168+0000 7efeb242d640 1 -- 172.21.15.57:0/3254311705 >> 172.21.15.57:0/3254311705 conn(0x7efeac09aa00 msgr2=0x7efeac09ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:42.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.168+0000 7efeb242d640 1 -- 172.21.15.57:0/3254311705 shutdown_connections 2024-04-24T01:48:42.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.168+0000 7efeb242d640 1 -- 172.21.15.57:0/3254311705 wait complete. 2024-04-24T01:48:42.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.168+0000 7efeb242d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:42.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.171+0000 7efeb242d640 1 Processor -- start 2024-04-24T01:48:42.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.171+0000 7efeb242d640 1 -- start start 2024-04-24T01:48:42.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.172+0000 7efeb242d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efeac0a0630 0x7efeac11f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:42.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.172+0000 7efeb242d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7efeac120840 con 0x7efeac0a0630 2024-04-24T01:48:42.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.172+0000 7efeabfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efeac0a0630 0x7efeac11f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:42.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.172+0000 7efeabfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efeac0a0630 0x7efeac11f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36020/0 (socket says 172.21.15.57:36020) 2024-04-24T01:48:42.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.172+0000 7efeabfff640 1 -- 172.21.15.57:0/2341520979 learned_addr learned my addr 172.21.15.57:0/2341520979 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T01:48:42.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.172+0000 7efeabfff640 1 -- 172.21.15.57:0/2341520979 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeac0731a0 con 0x7efeac0a0630 2024-04-24T01:48:42.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.172+0000 7efeabfff640 1 --2- 172.21.15.57:0/2341520979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efeac0a0630 0x7efeac11f680 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:42.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.172+0000 7efea8ff9640 1 -- 172.21.15.57:0/2341520979 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efe94005a60 con 0x7efeac0a0630 2024-04-24T01:48:42.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.172+0000 7efea8ff9640 1 -- 172.21.15.57:0/2341520979 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efe94005bc0 con 0x7efeac0a0630 2024-04-24T01:48:42.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.172+0000 7efeb242d640 1 -- 172.21.15.57:0/2341520979 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeac1324a0 con 0x7efeac0a0630 2024-04-24T01:48:42.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.172+0000 7efea8ff9640 1 -- 172.21.15.57:0/2341520979 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efe94005e60 con 0x7efeac0a0630 2024-04-24T01:48:42.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.172+0000 7efeb242d640 1 -- 172.21.15.57:0/2341520979 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeac1321d0 con 0x7efeac0a0630 2024-04-24T01:48:42.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.173+0000 7efeb242d640 1 -- 172.21.15.57:0/2341520979 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeac073b20 con 0x7efeac0a0630 2024-04-24T01:48:42.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.173+0000 7efea8ff9640 1 -- 172.21.15.57:0/2341520979 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7efe940070b0 con 0x7efeac0a0630 2024-04-24T01:48:42.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.173+0000 7efea8ff9640 1 --2- 172.21.15.57:0/2341520979 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7efe8c038920 0x7efe8c03ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:42.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.174+0000 7efea8ff9640 1 -- 172.21.15.57:0/2341520979 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7efe94048150 con 0x7efeac0a0630 2024-04-24T01:48:42.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.174+0000 7efeab7fe640 1 --2- 172.21.15.57:0/2341520979 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7efe8c038920 0x7efe8c03ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:42.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.174+0000 7efeab7fe640 1 --2- 172.21.15.57:0/2341520979 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7efe8c038920 0x7efe8c03ae30 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:42.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.179+0000 7efea8ff9640 1 -- 172.21.15.57:0/2341520979 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7efe9400d510 con 0x7efeac0a0630 2024-04-24T01:48:42.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.360+0000 7efeb242d640 1 -- 172.21.15.57:0/2341520979 --> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efeac06f380 con 0x7efe8c038920 2024-04-24T01:48:42.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.362+0000 7efea8ff9640 1 -- 172.21.15.57:0/2341520979 <== mgr.4101 v2:172.21.15.84:6800/1747524692 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+31068 (crc 0 0 0) 0x7efe9c009ce0 con 0x7efe8c038920 2024-04-24T01:48:42.363 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:42.363 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-24T01:48:42.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.364+0000 7efeb242d640 1 -- 172.21.15.57:0/2341520979 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7efe8c038920 msgr2=0x7efe8c03ae30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:42.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.364+0000 7efeb242d640 1 --2- 172.21.15.57:0/2341520979 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7efe8c038920 0x7efe8c03ae30 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:42.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.364+0000 7efeb242d640 1 -- 172.21.15.57:0/2341520979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efeac0a0630 msgr2=0x7efeac11f680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:42.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.364+0000 7efeb242d640 1 --2- 172.21.15.57:0/2341520979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efeac0a0630 0x7efeac11f680 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:42.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.364+0000 7efeb242d640 1 -- 172.21.15.57:0/2341520979 shutdown_connections 2024-04-24T01:48:42.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.364+0000 7efeb242d640 1 --2- 172.21.15.57:0/2341520979 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7efe8c038920 0x7efe8c03ae30 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:42.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.364+0000 7efeb242d640 1 --2- 172.21.15.57:0/2341520979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efeac0a0630 0x7efeac11f680 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:42.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.364+0000 7efeb242d640 1 -- 172.21.15.57:0/2341520979 >> 172.21.15.57:0/2341520979 conn(0x7efeac09aa00 msgr2=0x7efeac0a36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:42.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.364+0000 7efeb242d640 1 -- 172.21.15.57:0/2341520979 shutdown_connections 2024-04-24T01:48:42.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.364+0000 7efeb242d640 1 -- 172.21.15.57:0/2341520979 wait complete. 2024-04-24T01:48:42.376 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-04-24T01:48:41.236604+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":109776,"kb_used_data":1592,"kb_used_omap":0,"kb_used_meta":107776,"kb_avail":419320624,"statfs":{"total":429496729600,"available":429384318976,"internally_reserved":0,"allocated":1630208,"data_stored":1289732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":110362624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-24T01:48:40.060552+0000","last_change":"2024-04-24T01:48:40.062414+0000","last_active":"2024-04-24T01:48:40.060552+0000","last_peered":"2024-04-24T01:48:40.060552+0000","last_clean":"2024-04-24T01:48:38.975626+0000","last_became_active":"2024-04-24T01:48:40.055629+0000","last_became_peered":"2024-04-24T01:48:40.055629+0000","last_unstale":"2024-04-24T01:48:40.060552+0000","last_undegraded":"2024-04-24T01:48:40.060552+0000","last_fullsized":"2024-04-24T01:48:40.060552+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-24T01:48:40.044646+0000","last_change":"2024-04-24T01:48:40.045311+0000","last_active":"2024-04-24T01:48:40.044646+0000","last_peered":"2024-04-24T01:48:40.044646+0000","last_clean":"2024-04-24T01:48:38.975626+0000","last_became_active":"2024-04-24T01:48:40.041551+0000","last_became_peered":"2024-04-24T01:48:40.041551+0000","last_unstale":"2024-04-24T01:48:40.044646+0000","last_undegraded":"2024-04-24T01:48:40.044646+0000","last_fullsized":"2024-04-24T01:48:40.044646+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-24T01:48:41.008289+0000","last_change":"2024-04-24T01:48:40.045108+0000","last_active":"2024-04-24T01:48:41.008289+0000","last_peered":"2024-04-24T01:48:41.008289+0000","last_clean":"2024-04-24T01:48:41.008289+0000","last_became_active":"2024-04-24T01:48:40.038574+0000","last_became_peered":"2024-04-24T01:48:40.038574+0000","last_unstale":"2024-04-24T01:48:41.008289+0000","last_undegraded":"2024-04-24T01:48:41.008289+0000","last_fullsized":"2024-04-24T01:48:41.008289+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-24T01:48:40.034298+0000","last_change":"2024-04-24T01:48:40.035237+0000","last_active":"2024-04-24T01:48:40.034298+0000","last_peered":"2024-04-24T01:48:40.034298+0000","last_clean":"2024-04-24T01:48:38.975626+0000","last_became_active":"2024-04-24T01:48:40.030062+0000","last_became_peered":"2024-04-24T01:48:40.030062+0000","last_unstale":"2024-04-24T01:48:40.034298+0000","last_undegraded":"2024-04-24T01:48:40.034298+0000","last_fullsized":"2024-04-24T01:48:40.034298+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-24T01:48:40.045341+0000","last_change":"2024-04-24T01:48:40.046631+0000","last_active":"2024-04-24T01:48:40.045341+0000","last_peered":"2024-04-24T01:48:40.045341+0000","last_clean":"2024-04-24T01:48:38.975626+0000","last_became_active":"2024-04-24T01:48:40.040843+0000","last_became_peered":"2024-04-24T01:48:40.040843+0000","last_unstale":"2024-04-24T01:48:40.045341+0000","last_undegraded":"2024-04-24T01:48:40.045341+0000","last_fullsized":"2024-04-24T01:48:40.045341+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-24T01:48:40.041903+0000","last_change":"2024-04-24T01:48:40.043159+0000","last_active":"2024-04-24T01:48:40.041903+0000","last_peered":"2024-04-24T01:48:40.041903+0000","last_clean":"2024-04-24T01:48:38.975626+0000","last_became_active":"2024-04-24T01:48:40.033297+0000","last_became_peered":"2024-04-24T01:48:40.033297+0000","last_unstale":"2024-04-24T01:48:40.041903+0000","last_undegraded":"2024-04-24T01:48:40.041903+0000","last_fullsized":"2024-04-24T01:48:40.041903+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-24T01:48:40.061745+0000","last_change":"2024-04-24T01:48:40.063620+0000","last_active":"2024-04-24T01:48:40.061745+0000","last_peered":"2024-04-24T01:48:40.061745+0000","last_clean":"2024-04-24T01:48:38.975626+0000","last_became_active":"2024-04-24T01:48:40.054792+0000","last_became_peered":"2024-04-24T01:48:40.054792+0000","last_unstale":"2024-04-24T01:48:40.061745+0000","last_undegraded":"2024-04-24T01:48:40.061745+0000","last_fullsized":"2024-04-24T01:48:40.061745+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2024-04-24T01:48:40.056730+0000","last_change":"2024-04-24T01:48:40.057853+0000","last_active":"2024-04-24T01:48:40.056730+0000","last_peered":"2024-04-24T01:48:40.056730+0000","last_clean":"2024-04-24T01:48:38.975626+0000","last_became_active":"2024-04-24T01:48:40.052084+0000","last_became_peered":"2024-04-24T01:48:40.052084+0000","last_unstale":"2024-04-24T01:48:40.056730+0000","last_undegraded":"2024-04-24T01:48:40.056730+0000","last_fullsized":"2024-04-24T01:48:40.056730+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":144,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-04-24T01:48:41.005093+0000","last_change":"2024-04-24T01:48:38.013745+0000","last_active":"2024-04-24T01:48:41.005093+0000","last_peered":"2024-04-24T01:48:41.005093+0000","last_clean":"2024-04-24T01:48:41.005093+0000","last_became_active":"2024-04-24T01:48:38.008438+0000","last_became_peered":"2024-04-24T01:48:38.008438+0000","last_unstale":"2024-04-24T01:48:41.005093+0000","last_undegraded":"2024-04-24T01:48:41.005093+0000","last_fullsized":"2024-04-24T01:48:41.005093+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:36.956380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:36.956380+0000","last_clean_scrub_stamp":"2024-04-24T01:48:36.956380+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27828,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829772,"statfs":{"total":107374182400,"available":107345686528,"internally_reserved":0,"allocated":704512,"data_stored":617617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27060,"kb_used_data":108,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830540,"statfs":{"total":107374182400,"available":107346472960,"internally_reserved":0,"allocated":110592,"data_stored":27249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27060,"kb_used_data":108,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104830540,"statfs":{"total":107374182400,"available":107346472960,"internally_reserved":0,"allocated":110592,"data_stored":27249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":27828,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":104829772,"statfs":{"total":107374182400,"available":107345686528,"internally_reserved":0,"allocated":704512,"data_stored":617617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T01:48:42.376 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-24T01:48:42.377 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-24T01:48:42.377 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-24T01:48:42.377 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-24T01:48:42.487 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.484+0000 7f012b0ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:42.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.487+0000 7f012b0ad640 1 Processor -- start 2024-04-24T01:48:42.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.487+0000 7f012b0ad640 1 -- start start 2024-04-24T01:48:42.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.490+0000 7f012b0ad640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f012409e7c0 0x7f01240a28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:42.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.490+0000 7f012b0ad640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01240a0120 con 0x7f01240a2e10 2024-04-24T01:48:42.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.490+0000 7f012b0ad640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f012406f270 con 0x7f012409e7c0 2024-04-24T01:48:42.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.490+0000 7f0128e49640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f012409e7c0 0x7f01240a28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:42.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.490+0000 7f0123fff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f01240a2e10 0x7f0124131650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:59096/0 (socket says 172.21.15.57:59096) 2024-04-24T01:48:42.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.490+0000 7f0123fff640 1 -- 172.21.15.57:0/3996929027 learned_addr learned my addr 172.21.15.57:0/3996929027 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T01:48:42.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.490+0000 7f01237fe640 1 -- 172.21.15.57:0/3996929027 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3899506186 0 0) 0x7f01240a0120 con 0x7f01240a2e10 2024-04-24T01:48:42.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.490+0000 7f01237fe640 1 -- 172.21.15.57:0/3996929027 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f010c003580 con 0x7f01240a2e10 2024-04-24T01:48:42.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.490+0000 7f0128e49640 1 -- 172.21.15.57:0/3996929027 >> v1:172.21.15.57:6789/0 conn(0x7f01240a2e10 legacy=0x7f0124131650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:42.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.490+0000 7f0128e49640 1 -- 172.21.15.57:0/3996929027 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f012409e430 con 0x7f012409e7c0 2024-04-24T01:48:42.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.490+0000 7f0128e49640 1 --2- 172.21.15.57:0/3996929027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f012409e7c0 0x7f01240a28d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c79e85ccd24dafdc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:42.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.490+0000 7f01237fe640 1 -- 172.21.15.57:0/3996929027 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0114009d90 con 0x7f012409e7c0 2024-04-24T01:48:42.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.490+0000 7f01237fe640 1 -- 172.21.15.57:0/3996929027 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f011400e230 con 0x7f012409e7c0 2024-04-24T01:48:42.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.490+0000 7f01237fe640 1 -- 172.21.15.57:0/3996929027 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f011400e4d0 con 0x7f012409e7c0 2024-04-24T01:48:42.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.490+0000 7f012b0ad640 1 -- 172.21.15.57:0/3996929027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f012409e7c0 msgr2=0x7f01240a28d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:42.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.490+0000 7f012b0ad640 1 --2- 172.21.15.57:0/3996929027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f012409e7c0 0x7f01240a28d0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:42.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.490+0000 7f012b0ad640 1 -- 172.21.15.57:0/3996929027 shutdown_connections 2024-04-24T01:48:42.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.490+0000 7f012b0ad640 1 --2- 172.21.15.57:0/3996929027 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f012409e7c0 0x7f01240a28d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:42.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.490+0000 7f012b0ad640 1 -- 172.21.15.57:0/3996929027 >> 172.21.15.57:0/3996929027 conn(0x7f012406e2c0 msgr2=0x7f012406e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:42.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.491+0000 7f012b0ad640 1 -- 172.21.15.57:0/3996929027 shutdown_connections 2024-04-24T01:48:42.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.491+0000 7f012b0ad640 1 -- 172.21.15.57:0/3996929027 wait complete. 2024-04-24T01:48:42.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.491+0000 7f012b0ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:48:42.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.492+0000 7f012b0ad640 1 Processor -- start 2024-04-24T01:48:42.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.493+0000 7f012b0ad640 1 -- start start 2024-04-24T01:48:42.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.494+0000 7f012b0ad640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01240a2e10 0x7f0124121090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:42.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.494+0000 7f012b0ad640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0124125240 con 0x7f01240a2e10 2024-04-24T01:48:42.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.494+0000 7f0128e49640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01240a2e10 0x7f0124121090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:42.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.494+0000 7f0128e49640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01240a2e10 0x7f0124121090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:36024/0 (socket says 172.21.15.57:36024) 2024-04-24T01:48:42.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.494+0000 7f0128e49640 1 -- 172.21.15.57:0/316389854 learned_addr learned my addr 172.21.15.57:0/316389854 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T01:48:42.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.495+0000 7f0128e49640 1 -- 172.21.15.57:0/316389854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01241321a0 con 0x7f01240a2e10 2024-04-24T01:48:42.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.495+0000 7f0128e49640 1 --2- 172.21.15.57:0/316389854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01240a2e10 0x7f0124121090 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:42.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.495+0000 7f01217fa640 1 -- 172.21.15.57:0/316389854 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f011400eeb0 con 0x7f01240a2e10 2024-04-24T01:48:42.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.495+0000 7f01217fa640 1 -- 172.21.15.57:0/316389854 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0114013400 con 0x7f01240a2e10 2024-04-24T01:48:42.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.495+0000 7f012b0ad640 1 -- 172.21.15.57:0/316389854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0124123530 con 0x7f01240a2e10 2024-04-24T01:48:42.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.495+0000 7f01217fa640 1 -- 172.21.15.57:0/316389854 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f01140136a0 con 0x7f01240a2e10 2024-04-24T01:48:42.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.495+0000 7f012b0ad640 1 -- 172.21.15.57:0/316389854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0124123d80 con 0x7f01240a2e10 2024-04-24T01:48:42.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.496+0000 7f01217fa640 1 -- 172.21.15.57:0/316389854 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f0114013850 con 0x7f01240a2e10 2024-04-24T01:48:42.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.496+0000 7f012b0ad640 1 -- 172.21.15.57:0/316389854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01241238f0 con 0x7f01240a2e10 2024-04-24T01:48:42.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.496+0000 7f01217fa640 1 --2- 172.21.15.57:0/316389854 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f0110038980 0x7f011003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:48:42.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.496+0000 7f01217fa640 1 -- 172.21.15.57:0/316389854 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2672+0+0 (crc 0 0 0) 0x7f0114018040 con 0x7f01240a2e10 2024-04-24T01:48:42.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.497+0000 7f0123fff640 1 --2- 172.21.15.57:0/316389854 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f0110038980 0x7f011003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:48:42.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.497+0000 7f0123fff640 1 --2- 172.21.15.57:0/316389854 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f0110038980 0x7f011003ae90 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:48:42.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.501+0000 7f01217fa640 1 -- 172.21.15.57:0/316389854 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f0114017880 con 0x7f01240a2e10 2024-04-24T01:48:42.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.728+0000 7f012b0ad640 1 -- 172.21.15.57:0/316389854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0124063900 con 0x7f01240a2e10 2024-04-24T01:48:42.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.729+0000 7f01217fa640 1 -- 172.21.15.57:0/316389854 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (crc 0 0 0) 0x7f01140176a0 con 0x7f01240a2e10 2024-04-24T01:48:42.730 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T01:48:42.730 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-24T01:48:42.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.731+0000 7f012b0ad640 1 -- 172.21.15.57:0/316389854 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f0110038980 msgr2=0x7f011003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:42.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.731+0000 7f012b0ad640 1 --2- 172.21.15.57:0/316389854 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f0110038980 0x7f011003ae90 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:42.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.731+0000 7f012b0ad640 1 -- 172.21.15.57:0/316389854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01240a2e10 msgr2=0x7f0124121090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:48:42.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.731+0000 7f012b0ad640 1 --2- 172.21.15.57:0/316389854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01240a2e10 0x7f0124121090 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:42.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.731+0000 7f012b0ad640 1 -- 172.21.15.57:0/316389854 shutdown_connections 2024-04-24T01:48:42.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.731+0000 7f012b0ad640 1 --2- 172.21.15.57:0/316389854 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f0110038980 0x7f011003ae90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:42.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.731+0000 7f012b0ad640 1 --2- 172.21.15.57:0/316389854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f01240a2e10 0x7f0124121090 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:48:42.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.731+0000 7f012b0ad640 1 -- 172.21.15.57:0/316389854 >> 172.21.15.57:0/316389854 conn(0x7f012406e2c0 msgr2=0x7f01240a17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:48:42.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.731+0000 7f012b0ad640 1 -- 172.21.15.57:0/316389854 shutdown_connections 2024-04-24T01:48:42.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T01:48:42.731+0000 7f012b0ad640 1 -- 172.21.15.57:0/316389854 wait complete. 2024-04-24T01:48:42.743 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-24T01:48:42.744 INFO:teuthology.run_tasks:Running task workunit... 2024-04-24T01:48:42.758 INFO:tasks.workunit:Pulling workunits from ref 424d8c4389b684b0a4d72510e1b4d398d8e6c8f4 2024-04-24T01:48:42.758 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-24T01:48:42.759 DEBUG:teuthology.orchestra.run.smithi057:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-24T01:48:42.774 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T01:48:42.774 INFO:teuthology.orchestra.run.smithi057.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-24T01:48:42.774 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-04-24T01:48:42.830 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-04-24T01:48:42.830 DEBUG:teuthology.orchestra.run.smithi057:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-04-24T01:48:42.884 INFO:tasks.workunit:timeout=3h 2024-04-24T01:48:42.885 INFO:tasks.workunit:cleanup=True 2024-04-24T01:48:42.885 DEBUG:teuthology.orchestra.run.smithi057:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 424d8c4389b684b0a4d72510e1b4d398d8e6c8f4 2024-04-24T01:48:42.941 INFO:tasks.workunit.client.0.smithi057.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-24T01:50:20.266 INFO:tasks.workunit.client.0.smithi057.stderr:Updating files: 95% (11749/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-24T01:50:20.805 INFO:tasks.workunit.client.0.smithi057.stderr:Note: switching to '424d8c4389b684b0a4d72510e1b4d398d8e6c8f4'. 2024-04-24T01:50:20.805 INFO:tasks.workunit.client.0.smithi057.stderr: 2024-04-24T01:50:20.805 INFO:tasks.workunit.client.0.smithi057.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-24T01:50:20.805 INFO:tasks.workunit.client.0.smithi057.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-24T01:50:20.805 INFO:tasks.workunit.client.0.smithi057.stderr:state without impacting any branches by switching back to a branch. 2024-04-24T01:50:20.805 INFO:tasks.workunit.client.0.smithi057.stderr: 2024-04-24T01:50:20.805 INFO:tasks.workunit.client.0.smithi057.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-24T01:50:20.805 INFO:tasks.workunit.client.0.smithi057.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-24T01:50:20.805 INFO:tasks.workunit.client.0.smithi057.stderr: 2024-04-24T01:50:20.805 INFO:tasks.workunit.client.0.smithi057.stderr: git switch -c 2024-04-24T01:50:20.806 INFO:tasks.workunit.client.0.smithi057.stderr: 2024-04-24T01:50:20.806 INFO:tasks.workunit.client.0.smithi057.stderr:Or undo this operation with: 2024-04-24T01:50:20.806 INFO:tasks.workunit.client.0.smithi057.stderr: 2024-04-24T01:50:20.806 INFO:tasks.workunit.client.0.smithi057.stderr: git switch - 2024-04-24T01:50:20.806 INFO:tasks.workunit.client.0.smithi057.stderr: 2024-04-24T01:50:20.806 INFO:tasks.workunit.client.0.smithi057.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-24T01:50:20.806 INFO:tasks.workunit.client.0.smithi057.stderr: 2024-04-24T01:50:20.806 INFO:tasks.workunit.client.0.smithi057.stderr:HEAD is now at 424d8c4389b crimson/osd/osd_operations: introduce concurrent lock_obc phase 2024-04-24T01:50:20.811 DEBUG:teuthology.orchestra.run.smithi057:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-24T01:50:20.879 INFO:tasks.workunit.client.0.smithi057.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-24T01:50:20.882 INFO:tasks.workunit.client.0.smithi057.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-24T01:50:20.882 INFO:tasks.workunit.client.0.smithi057.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-24T01:50:21.578 INFO:tasks.workunit.client.0.smithi057.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-24T01:50:21.636 INFO:tasks.workunit.client.0.smithi057.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-24T01:50:21.678 INFO:tasks.workunit.client.0.smithi057.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-24T01:50:21.679 INFO:tasks.workunit.client.0.smithi057.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-24T01:50:21.679 INFO:tasks.workunit.client.0.smithi057.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-24T01:50:21.720 INFO:tasks.workunit.client.0.smithi057.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-24T01:50:21.723 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-04-24T01:50:21.723 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-24T01:50:21.778 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-04-24T01:50:21.780 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-04-24T01:50:21.780 DEBUG:teuthology.orchestra.run.smithi057:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=424d8c4389b684b0a4d72510e1b4d398d8e6c8f4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh --crimson 2024-04-24T01:50:21.839 INFO:tasks.workunit.client.0.smithi057.stderr:+ parallel=1 2024-04-24T01:50:21.839 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' --crimson = --serial ']' 2024-04-24T01:50:21.839 INFO:tasks.workunit.client.0.smithi057.stderr:+ crimson=0 2024-04-24T01:50:21.839 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' --crimson = --crimson ']' 2024-04-24T01:50:21.839 INFO:tasks.workunit.client.0.smithi057.stderr:+ parallel=0 2024-04-24T01:50:21.839 INFO:tasks.workunit.client.0.smithi057.stderr:+ crimson=1 2024-04-24T01:50:21.839 INFO:tasks.workunit.client.0.smithi057.stderr:+ color= 2024-04-24T01:50:21.839 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' -t 1 ']' 2024-04-24T01:50:21.839 INFO:tasks.workunit.client.0.smithi057.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-04-24T01:50:21.840 INFO:tasks.workunit.client.0.smithi057.stderr:+ GTEST_OUTPUT_DIR=/home/ubuntu/cephtest/archive/unit_test_xml_report 2024-04-24T01:50:21.840 INFO:tasks.workunit.client.0.smithi057.stderr:+ mkdir -p /home/ubuntu/cephtest/archive/unit_test_xml_report 2024-04-24T01:50:21.840 INFO:tasks.workunit.client.0.smithi057.stderr:+ declare -A pids 2024-04-24T01:50:21.840 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-24T01:50:21.840 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T01:50:21.840 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_rados_api_aio 2024-04-24T01:50:21.856 INFO:tasks.workunit.client.0.smithi057.stdout:Running main() from gmock_main.cc 2024-04-24T01:50:21.856 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 42 tests from 2 test suites. 2024-04-24T01:50:21.857 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T01:50:21.857 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 26 tests from LibRadosAio 2024-04-24T01:50:21.857 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.TooBig 2024-04-24T01:50:24.670 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.TooBig (2813 ms) 2024-04-24T01:50:24.670 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.SimpleWrite 2024-04-24T01:50:27.706 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.SimpleWrite (3037 ms) 2024-04-24T01:50:27.707 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.WaitForSafe 2024-04-24T01:50:30.712 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.WaitForSafe (3006 ms) 2024-04-24T01:50:30.713 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.RoundTrip 2024-04-24T01:50:33.741 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.RoundTrip (3029 ms) 2024-04-24T01:50:33.742 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.RoundTrip2 2024-04-24T01:50:36.763 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.RoundTrip2 (3021 ms) 2024-04-24T01:50:36.763 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.RoundTrip3 2024-04-24T01:50:39.797 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.RoundTrip3 (3035 ms) 2024-04-24T01:50:39.797 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.RoundTripAppend 2024-04-24T01:50:42.815 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.RoundTripAppend (3017 ms) 2024-04-24T01:50:42.815 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.RemoveTest 2024-04-24T01:50:45.848 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.RemoveTest (3033 ms) 2024-04-24T01:50:45.848 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.XattrsRoundTrip 2024-04-24T01:50:48.861 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.XattrsRoundTrip (3012 ms) 2024-04-24T01:50:48.862 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.RmXattr 2024-04-24T01:50:51.892 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.RmXattr (3033 ms) 2024-04-24T01:50:51.892 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.XattrIter 2024-04-24T01:50:54.913 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.XattrIter (3019 ms) 2024-04-24T01:50:54.913 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.IsComplete 2024-04-24T01:50:57.952 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.IsComplete (3040 ms) 2024-04-24T01:50:57.952 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.IsSafe 2024-04-24T01:51:00.967 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.IsSafe (3015 ms) 2024-04-24T01:51:00.967 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.ReturnValue 2024-04-24T01:51:03.983 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.ReturnValue (3017 ms) 2024-04-24T01:51:03.984 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.Flush 2024-04-24T01:51:07.011 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.Flush (3027 ms) 2024-04-24T01:51:07.011 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.FlushAsync 2024-04-24T01:51:10.047 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.FlushAsync (3036 ms) 2024-04-24T01:51:10.047 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.RoundTripWriteFull 2024-04-24T01:51:13.068 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.RoundTripWriteFull (3022 ms) 2024-04-24T01:51:13.068 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.RoundTripWriteSame 2024-04-24T01:51:16.085 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.RoundTripWriteSame (3016 ms) 2024-04-24T01:51:16.085 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.SimpleStat 2024-04-24T01:51:18.539 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.SimpleStat (2455 ms) 2024-04-24T01:51:18.540 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.OperateMtime 2024-04-24T01:51:21.573 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.OperateMtime (3033 ms) 2024-04-24T01:51:21.573 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.Operate2Mtime 2024-04-24T01:51:24.595 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.Operate2Mtime (3023 ms) 2024-04-24T01:51:24.595 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.SimpleStatNS 2024-04-24T01:51:27.618 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.SimpleStatNS (3022 ms) 2024-04-24T01:51:27.618 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.StatRemove 2024-04-24T01:51:30.646 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.StatRemove (3028 ms) 2024-04-24T01:51:30.646 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.ExecuteClass 2024-04-24T01:51:33.537 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.ExecuteClass (2892 ms) 2024-04-24T01:51:33.537 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.MultiWrite 2024-04-24T01:51:36.544 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.MultiWrite (3007 ms) 2024-04-24T01:51:36.545 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.AioUnlock 2024-04-24T01:51:39.576 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.AioUnlock (3029 ms) 2024-04-24T01:51:39.576 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 26 tests from LibRadosAio (77717 ms total) 2024-04-24T01:51:39.577 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:51:39.577 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 16 tests from LibRadosAioEC 2024-04-24T01:51:39.577 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.SimpleWrite 2024-04-24T01:51:39.577 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio.cc:1100: Skipped 2024-04-24T01:51:39.577 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:51:39.577 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWrite (0 ms) 2024-04-24T01:51:39.577 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.WaitForComplete 2024-04-24T01:51:39.577 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio.cc:1132: Skipped 2024-04-24T01:51:39.577 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:51:39.577 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.WaitForComplete (0 ms) 2024-04-24T01:51:39.577 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.RoundTrip 2024-04-24T01:51:39.577 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio.cc:1149: Skipped 2024-04-24T01:51:39.577 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:51:39.577 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip (0 ms) 2024-04-24T01:51:39.578 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.RoundTrip2 2024-04-24T01:51:39.578 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio.cc:1182: Skipped 2024-04-24T01:51:39.578 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:51:39.578 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip2 (0 ms) 2024-04-24T01:51:39.578 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.RoundTripAppend 2024-04-24T01:51:39.578 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio.cc:1215: Skipped 2024-04-24T01:51:39.578 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:51:39.578 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppend (0 ms) 2024-04-24T01:51:39.578 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.IsComplete 2024-04-24T01:51:39.578 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio.cc:1286: Skipped 2024-04-24T01:51:39.578 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:51:39.578 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.IsComplete (0 ms) 2024-04-24T01:51:39.578 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.IsSafe 2024-04-24T01:51:39.578 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio.cc:1326: Skipped 2024-04-24T01:51:39.579 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:51:39.579 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.IsSafe (0 ms) 2024-04-24T01:51:39.579 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.ReturnValue 2024-04-24T01:51:39.579 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio.cc:1366: Skipped 2024-04-24T01:51:39.579 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:51:39.579 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValue (0 ms) 2024-04-24T01:51:39.579 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.Flush 2024-04-24T01:51:39.579 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio.cc:1385: Skipped 2024-04-24T01:51:39.579 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:51:39.579 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.Flush (0 ms) 2024-04-24T01:51:39.579 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.FlushAsync 2024-04-24T01:51:39.579 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio.cc:1415: Skipped 2024-04-24T01:51:39.579 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:51:39.579 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsync (0 ms) 2024-04-24T01:51:39.579 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-04-24T01:51:39.579 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio.cc:1454: Skipped 2024-04-24T01:51:39.580 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:51:39.580 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFull (0 ms) 2024-04-24T01:51:39.580 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.SimpleStat 2024-04-24T01:51:39.580 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio.cc:1498: Skipped 2024-04-24T01:51:39.580 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:51:39.580 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStat (0 ms) 2024-04-24T01:51:39.580 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.SimpleStatNS 2024-04-24T01:51:39.580 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio.cc:1532: Skipped 2024-04-24T01:51:39.580 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:51:39.580 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatNS (0 ms) 2024-04-24T01:51:39.580 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.StatRemove 2024-04-24T01:51:39.580 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio.cc:1593: Skipped 2024-04-24T01:51:39.580 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:51:39.580 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.StatRemove (0 ms) 2024-04-24T01:51:39.580 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.ExecuteClass 2024-04-24T01:51:39.580 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio.cc:1649: Skipped 2024-04-24T01:51:39.581 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:51:39.581 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClass (0 ms) 2024-04-24T01:51:39.581 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.MultiWrite 2024-04-24T01:51:39.581 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio.cc:1681: Skipped 2024-04-24T01:51:39.581 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:51:39.581 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.MultiWrite (0 ms) 2024-04-24T01:51:39.581 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 16 tests from LibRadosAioEC (0 ms total) 2024-04-24T01:51:39.581 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:51:39.581 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T01:51:39.581 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 42 tests from 2 test suites ran. (77717 ms total) 2024-04-24T01:51:39.581 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 26 tests. 2024-04-24T01:51:39.581 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] 16 tests, listed below: 2024-04-24T01:51:39.581 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWrite 2024-04-24T01:51:39.581 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.WaitForComplete 2024-04-24T01:51:39.581 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip 2024-04-24T01:51:39.582 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.RoundTrip2 2024-04-24T01:51:39.582 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppend 2024-04-24T01:51:39.582 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.IsComplete 2024-04-24T01:51:39.582 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.IsSafe 2024-04-24T01:51:39.582 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValue 2024-04-24T01:51:39.582 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.Flush 2024-04-24T01:51:39.582 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsync 2024-04-24T01:51:39.582 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFull 2024-04-24T01:51:39.582 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStat 2024-04-24T01:51:39.582 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatNS 2024-04-24T01:51:39.582 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.StatRemove 2024-04-24T01:51:39.582 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClass 2024-04-24T01:51:39.582 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.MultiWrite 2024-04-24T01:51:39.583 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-24T01:51:39.583 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T01:51:39.583 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_rados_api_aio_pp 2024-04-24T01:51:39.597 INFO:tasks.workunit.client.0.smithi057.stdout:Running main() from gmock_main.cc 2024-04-24T01:51:39.597 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 57 tests from 4 test suites. 2024-04-24T01:51:39.597 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T01:51:39.597 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 32 tests from LibRadosAio 2024-04-24T01:51:39.598 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.TooBigPP 2024-04-24T01:51:42.573 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.TooBigPP (2976 ms) 2024-04-24T01:51:42.574 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.PoolQuotaPP 2024-04-24T01:52:02.605 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.PoolQuotaPP (20031 ms) 2024-04-24T01:52:02.605 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.SimpleWritePP 2024-04-24T01:52:08.543 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.SimpleWritePP (5938 ms) 2024-04-24T01:52:08.544 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.WaitForSafePP 2024-04-24T01:52:11.574 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.WaitForSafePP (3030 ms) 2024-04-24T01:52:11.574 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.RoundTripPP 2024-04-24T01:52:14.585 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.RoundTripPP (3011 ms) 2024-04-24T01:52:14.585 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.RoundTripPP2 2024-04-24T01:52:17.625 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.RoundTripPP2 (3041 ms) 2024-04-24T01:52:17.625 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.RoundTripPP3 2024-04-24T01:52:20.625 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.RoundTripPP3 (2999 ms) 2024-04-24T01:52:20.625 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-04-24T01:52:23.651 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.RoundTripSparseReadPP (3027 ms) 2024-04-24T01:52:23.652 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.IsCompletePP 2024-04-24T01:52:26.662 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.IsCompletePP (3010 ms) 2024-04-24T01:52:26.662 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.IsSafePP 2024-04-24T01:52:29.680 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.IsSafePP (3018 ms) 2024-04-24T01:52:29.680 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.ReturnValuePP 2024-04-24T01:52:32.697 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.ReturnValuePP (3018 ms) 2024-04-24T01:52:32.697 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.FlushPP 2024-04-24T01:52:35.727 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.FlushPP (3030 ms) 2024-04-24T01:52:35.728 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.FlushAsyncPP 2024-04-24T01:52:38.550 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.FlushAsyncPP (2822 ms) 2024-04-24T01:52:38.550 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-04-24T01:52:41.585 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.RoundTripWriteFullPP (3035 ms) 2024-04-24T01:52:41.585 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-04-24T01:52:44.606 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.RoundTripWriteFullPP2 (3021 ms) 2024-04-24T01:52:44.606 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-04-24T01:52:47.640 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.RoundTripWriteSamePP (3034 ms) 2024-04-24T01:52:47.640 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-04-24T01:52:50.642 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.RoundTripWriteSamePP2 (3002 ms) 2024-04-24T01:52:50.642 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.SimpleStatPPNS 2024-04-24T01:52:53.676 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.SimpleStatPPNS (3034 ms) 2024-04-24T01:52:53.676 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.SimpleStatPP 2024-04-24T01:52:56.696 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.SimpleStatPP (3021 ms) 2024-04-24T01:52:56.696 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.OperateMtime 2024-04-24T01:52:59.572 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.OperateMtime (2875 ms) 2024-04-24T01:52:59.572 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.OperateMtime2 2024-04-24T01:53:02.598 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.OperateMtime2 (3026 ms) 2024-04-24T01:53:02.598 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.StatRemovePP 2024-04-24T01:53:05.621 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.StatRemovePP (3023 ms) 2024-04-24T01:53:05.621 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.ExecuteClassPP 2024-04-24T01:53:08.556 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.ExecuteClassPP (2935 ms) 2024-04-24T01:53:08.556 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.OmapPP 2024-04-24T01:53:11.576 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.OmapPP (3020 ms) 2024-04-24T01:53:11.576 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.MultiWritePP 2024-04-24T01:53:14.585 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.MultiWritePP (3009 ms) 2024-04-24T01:53:14.585 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.AioUnlockPP 2024-04-24T01:53:17.613 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.AioUnlockPP (3028 ms) 2024-04-24T01:53:17.613 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.RoundTripAppendPP 2024-04-24T01:53:20.611 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.RoundTripAppendPP (2999 ms) 2024-04-24T01:53:20.611 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.RacingRemovePP 2024-04-24T01:53:23.627 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.RacingRemovePP (3016 ms) 2024-04-24T01:53:23.627 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-04-24T01:53:26.648 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.RoundTripCmpExtPP (3020 ms) 2024-04-24T01:53:26.648 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-04-24T01:53:29.666 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.RoundTripCmpExtPP2 (3015 ms) 2024-04-24T01:53:29.666 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.PoolEIOFlag 2024-04-24T01:53:32.180 INFO:tasks.workunit.client.0.smithi057.stdout:setting pool EIO 2024-04-24T01:53:41.859 INFO:tasks.workunit.client.0.smithi057.stdout:waiting for 773 2024-04-24T01:53:42.859 INFO:tasks.workunit.client.0.smithi057.stdout:waiting for 773 2024-04-24T01:53:43.859 INFO:tasks.workunit.client.0.smithi057.stdout:waiting for 773 2024-04-24T01:53:44.860 INFO:tasks.workunit.client.0.smithi057.stdout:max_success 227, min_failed 228 2024-04-24T01:53:45.722 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAio.PoolEIOFlag (16059 ms) 2024-04-24T01:53:45.722 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAio.MultiReads 2024-04-24T01:53:45.722 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio_cxx.cc:2427: Skipped 2024-04-24T01:53:45.722 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:53:45.722 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAio.MultiReads (0 ms) 2024-04-24T01:53:45.723 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 32 tests from LibRadosAio (126124 ms total) 2024-04-24T01:53:45.723 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:53:45.723 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 4 tests from LibRadosAioPP 2024-04-24T01:53:45.723 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-04-24T01:53:48.564 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAioPP.ReadIntoBufferlist (2842 ms) 2024-04-24T01:53:48.564 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-04-24T01:53:57.635 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAioPP.XattrsRoundTripPP (9071 ms) 2024-04-24T01:53:57.635 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioPP.RmXattrPP 2024-04-24T01:54:12.581 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAioPP.RmXattrPP (14946 ms) 2024-04-24T01:54:12.581 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioPP.RemoveTestPP 2024-04-24T01:54:15.617 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosAioPP.RemoveTestPP (3036 ms) 2024-04-24T01:54:15.617 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 4 tests from LibRadosAioPP (29895 ms total) 2024-04-24T01:54:15.617 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:54:15.617 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 1 test from LibRadosIoPP 2024-04-24T01:54:15.617 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoPP.XattrListPP 2024-04-24T01:54:18.633 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIoPP.XattrListPP (3014 ms) 2024-04-24T01:54:18.634 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 1 test from LibRadosIoPP (3014 ms total) 2024-04-24T01:54:18.634 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:54:18.634 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 20 tests from LibRadosAioEC 2024-04-24T01:54:18.634 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.SimpleWritePP 2024-04-24T01:54:18.634 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio_cxx.cc:1384: Skipped 2024-04-24T01:54:18.634 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:18.634 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWritePP (0 ms) 2024-04-24T01:54:18.634 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.WaitForSafePP 2024-04-24T01:54:18.634 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio_cxx.cc:1419: Skipped 2024-04-24T01:54:18.635 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:18.635 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.WaitForSafePP (0 ms) 2024-04-24T01:54:18.635 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.RoundTripPP 2024-04-24T01:54:18.635 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio_cxx.cc:1436: Skipped 2024-04-24T01:54:18.635 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:18.635 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP (0 ms) 2024-04-24T01:54:18.635 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.RoundTripPP2 2024-04-24T01:54:18.635 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio_cxx.cc:1467: Skipped 2024-04-24T01:54:18.635 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:18.635 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP2 (0 ms) 2024-04-24T01:54:18.635 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.RoundTripPP3 2024-04-24T01:54:18.635 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio_cxx.cc:1500: Skipped 2024-04-24T01:54:18.636 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:18.636 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP3 (0 ms) 2024-04-24T01:54:18.636 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-04-24T01:54:18.636 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio_cxx.cc:1605: Skipped 2024-04-24T01:54:18.636 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:18.636 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP (0 ms) 2024-04-24T01:54:18.636 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-04-24T01:54:18.636 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio_cxx.cc:1637: Skipped 2024-04-24T01:54:18.636 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:18.636 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppendPP (0 ms) 2024-04-24T01:54:18.636 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.IsCompletePP 2024-04-24T01:54:18.636 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio_cxx.cc:1705: Skipped 2024-04-24T01:54:18.636 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:18.636 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.IsCompletePP (0 ms) 2024-04-24T01:54:18.637 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.IsSafePP 2024-04-24T01:54:18.637 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio_cxx.cc:1742: Skipped 2024-04-24T01:54:18.637 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:18.637 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.IsSafePP (0 ms) 2024-04-24T01:54:18.637 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.ReturnValuePP 2024-04-24T01:54:18.637 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio_cxx.cc:1780: Skipped 2024-04-24T01:54:18.637 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:18.637 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValuePP (0 ms) 2024-04-24T01:54:18.637 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.FlushPP 2024-04-24T01:54:18.637 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio_cxx.cc:1796: Skipped 2024-04-24T01:54:18.637 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:18.638 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.FlushPP (0 ms) 2024-04-24T01:54:18.638 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.FlushAsyncPP 2024-04-24T01:54:18.638 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio_cxx.cc:1824: Skipped 2024-04-24T01:54:18.638 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:18.638 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsyncPP (0 ms) 2024-04-24T01:54:18.638 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-04-24T01:54:18.638 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio_cxx.cc:1859: Skipped 2024-04-24T01:54:18.638 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:18.638 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP (0 ms) 2024-04-24T01:54:18.638 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2024-04-24T01:54:18.638 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio_cxx.cc:1904: Skipped 2024-04-24T01:54:18.638 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:18.638 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 (0 ms) 2024-04-24T01:54:18.639 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.SimpleStatPP 2024-04-24T01:54:18.639 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio_cxx.cc:1946: Skipped 2024-04-24T01:54:18.639 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:18.639 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPP (0 ms) 2024-04-24T01:54:18.639 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-04-24T01:54:18.639 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio_cxx.cc:1977: Skipped 2024-04-24T01:54:18.639 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:18.639 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPPNS (0 ms) 2024-04-24T01:54:18.639 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.StatRemovePP 2024-04-24T01:54:18.639 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio_cxx.cc:2008: Skipped 2024-04-24T01:54:18.639 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:18.639 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.StatRemovePP (0 ms) 2024-04-24T01:54:18.639 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.ExecuteClassPP 2024-04-24T01:54:18.639 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio_cxx.cc:2059: Skipped 2024-04-24T01:54:18.640 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:18.640 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClassPP (0 ms) 2024-04-24T01:54:18.640 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.OmapPP 2024-04-24T01:54:18.640 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio_cxx.cc:2089: Skipped 2024-04-24T01:54:18.640 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:18.640 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.OmapPP (0 ms) 2024-04-24T01:54:18.640 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosAioEC.MultiWritePP 2024-04-24T01:54:18.640 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/aio_cxx.cc:2124: Skipped 2024-04-24T01:54:18.640 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:18.640 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.MultiWritePP (0 ms) 2024-04-24T01:54:18.640 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 20 tests from LibRadosAioEC (0 ms total) 2024-04-24T01:54:18.640 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:54:18.640 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T01:54:18.640 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 57 tests from 4 test suites ran. (159033 ms total) 2024-04-24T01:54:18.641 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 36 tests. 2024-04-24T01:54:18.641 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] 21 tests, listed below: 2024-04-24T01:54:18.641 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAio.MultiReads 2024-04-24T01:54:18.641 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.SimpleWritePP 2024-04-24T01:54:18.641 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.WaitForSafePP 2024-04-24T01:54:18.641 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP 2024-04-24T01:54:18.641 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP2 2024-04-24T01:54:18.641 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripPP3 2024-04-24T01:54:18.641 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripSparseReadPP 2024-04-24T01:54:18.641 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripAppendPP 2024-04-24T01:54:18.641 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.IsCompletePP 2024-04-24T01:54:18.641 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.IsSafePP 2024-04-24T01:54:18.641 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.ReturnValuePP 2024-04-24T01:54:18.641 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.FlushPP 2024-04-24T01:54:18.641 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.FlushAsyncPP 2024-04-24T01:54:18.642 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP 2024-04-24T01:54:18.642 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.RoundTripWriteFullPP2 2024-04-24T01:54:18.642 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPP 2024-04-24T01:54:18.642 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.SimpleStatPPNS 2024-04-24T01:54:18.642 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.StatRemovePP 2024-04-24T01:54:18.642 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.ExecuteClassPP 2024-04-24T01:54:18.642 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.OmapPP 2024-04-24T01:54:18.642 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosAioEC.MultiWritePP 2024-04-24T01:54:18.642 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-24T01:54:18.643 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T01:54:18.643 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_rados_api_io 2024-04-24T01:54:18.654 INFO:tasks.workunit.client.0.smithi057.stdout:Running main() from gmock_main.cc 2024-04-24T01:54:18.655 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 24 tests from 2 test suites. 2024-04-24T01:54:18.655 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T01:54:18.655 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 14 tests from LibRadosIo 2024-04-24T01:54:20.653 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIo.SimpleWrite 2024-04-24T01:54:21.030 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIo.SimpleWrite (376 ms) 2024-04-24T01:54:21.030 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIo.TooBig 2024-04-24T01:54:21.030 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIo.TooBig (0 ms) 2024-04-24T01:54:21.030 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIo.ReadTimeout 2024-04-24T01:54:21.094 INFO:tasks.workunit.client.0.smithi057.stdout:no timeout :/ 2024-04-24T01:54:21.094 INFO:tasks.workunit.client.0.smithi057.stdout:no timeout :/ 2024-04-24T01:54:21.094 INFO:tasks.workunit.client.0.smithi057.stdout:no timeout :/ 2024-04-24T01:54:21.094 INFO:tasks.workunit.client.0.smithi057.stdout:no timeout :/ 2024-04-24T01:54:21.094 INFO:tasks.workunit.client.0.smithi057.stdout:no timeout :/ 2024-04-24T01:54:21.094 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIo.ReadTimeout (64 ms) 2024-04-24T01:54:21.094 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIo.RoundTrip 2024-04-24T01:54:21.125 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIo.RoundTrip (32 ms) 2024-04-24T01:54:21.125 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIo.Checksum 2024-04-24T01:54:21.141 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIo.Checksum (15 ms) 2024-04-24T01:54:21.141 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-04-24T01:54:21.172 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIo.OverlappingWriteRoundTrip (31 ms) 2024-04-24T01:54:21.172 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIo.WriteFullRoundTrip 2024-04-24T01:54:21.194 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIo.WriteFullRoundTrip (23 ms) 2024-04-24T01:54:21.195 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIo.AppendRoundTrip 2024-04-24T01:54:21.219 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIo.AppendRoundTrip (24 ms) 2024-04-24T01:54:21.219 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIo.ZeroLenZero 2024-04-24T01:54:21.223 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIo.ZeroLenZero (5 ms) 2024-04-24T01:54:21.223 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIo.TruncTest 2024-04-24T01:54:21.248 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIo.TruncTest (24 ms) 2024-04-24T01:54:21.248 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIo.RemoveTest 2024-04-24T01:54:21.270 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIo.RemoveTest (23 ms) 2024-04-24T01:54:21.270 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIo.XattrsRoundTrip 2024-04-24T01:54:21.298 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIo.XattrsRoundTrip (28 ms) 2024-04-24T01:54:21.298 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIo.RmXattr 2024-04-24T01:54:21.370 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIo.RmXattr (71 ms) 2024-04-24T01:54:21.370 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIo.XattrIter 2024-04-24T01:54:21.403 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIo.XattrIter (33 ms) 2024-04-24T01:54:21.665 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 14 tests from LibRadosIo (749 ms total) 2024-04-24T01:54:21.665 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:54:21.665 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 10 tests from LibRadosIoEC 2024-04-24T01:54:21.665 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:168: Skipped 2024-04-24T01:54:21.665 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:21.665 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoEC.SimpleWrite 2024-04-24T01:54:21.665 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:182: Skipped 2024-04-24T01:54:21.665 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:21.665 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:196: Skipped 2024-04-24T01:54:21.665 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:21.666 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoEC.SimpleWrite (0 ms) 2024-04-24T01:54:21.666 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoEC.RoundTrip 2024-04-24T01:54:21.666 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:182: Skipped 2024-04-24T01:54:21.666 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:21.666 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:196: Skipped 2024-04-24T01:54:21.666 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:21.666 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoEC.RoundTrip (0 ms) 2024-04-24T01:54:21.666 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-04-24T01:54:21.666 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:182: Skipped 2024-04-24T01:54:21.666 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:21.666 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:196: Skipped 2024-04-24T01:54:21.666 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:21.666 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip (0 ms) 2024-04-24T01:54:21.667 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-04-24T01:54:21.667 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:182: Skipped 2024-04-24T01:54:21.667 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:21.667 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:196: Skipped 2024-04-24T01:54:21.667 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:21.667 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip (0 ms) 2024-04-24T01:54:21.667 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoEC.AppendRoundTrip 2024-04-24T01:54:21.667 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:182: Skipped 2024-04-24T01:54:21.667 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:21.667 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:196: Skipped 2024-04-24T01:54:21.667 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:21.667 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoEC.AppendRoundTrip (0 ms) 2024-04-24T01:54:21.667 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoEC.TruncTest 2024-04-24T01:54:21.667 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:182: Skipped 2024-04-24T01:54:21.667 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:21.667 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:196: Skipped 2024-04-24T01:54:21.668 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:21.668 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoEC.TruncTest (0 ms) 2024-04-24T01:54:21.668 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoEC.RemoveTest 2024-04-24T01:54:21.668 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:182: Skipped 2024-04-24T01:54:21.668 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:21.668 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:196: Skipped 2024-04-24T01:54:21.668 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:21.668 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoEC.RemoveTest (0 ms) 2024-04-24T01:54:21.668 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-04-24T01:54:21.668 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:182: Skipped 2024-04-24T01:54:21.668 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:21.668 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:196: Skipped 2024-04-24T01:54:21.668 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:21.668 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoEC.XattrsRoundTrip (0 ms) 2024-04-24T01:54:21.668 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoEC.RmXattr 2024-04-24T01:54:21.669 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:182: Skipped 2024-04-24T01:54:21.669 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:21.669 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:196: Skipped 2024-04-24T01:54:21.669 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:21.669 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoEC.RmXattr (0 ms) 2024-04-24T01:54:21.669 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoEC.XattrIter 2024-04-24T01:54:21.669 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:182: Skipped 2024-04-24T01:54:21.669 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:21.669 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:196: Skipped 2024-04-24T01:54:21.669 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:21.669 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoEC.XattrIter (0 ms) 2024-04-24T01:54:21.669 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:176: Skipped 2024-04-24T01:54:21.669 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:21.669 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 10 tests from LibRadosIoEC (0 ms total) 2024-04-24T01:54:21.669 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:54:21.669 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T01:54:21.670 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 24 tests from 2 test suites ran. (3010 ms total) 2024-04-24T01:54:21.670 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 14 tests. 2024-04-24T01:54:21.670 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] 10 tests, listed below: 2024-04-24T01:54:21.670 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoEC.SimpleWrite 2024-04-24T01:54:21.670 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoEC.RoundTrip 2024-04-24T01:54:21.670 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-04-24T01:54:21.670 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoEC.WriteFullRoundTrip 2024-04-24T01:54:21.670 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoEC.AppendRoundTrip 2024-04-24T01:54:21.670 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoEC.TruncTest 2024-04-24T01:54:21.670 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoEC.RemoveTest 2024-04-24T01:54:21.670 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoEC.XattrsRoundTrip 2024-04-24T01:54:21.670 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoEC.RmXattr 2024-04-24T01:54:21.670 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoEC.XattrIter 2024-04-24T01:54:21.671 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-24T01:54:21.671 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T01:54:21.671 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_rados_api_io_pp 2024-04-24T01:54:21.685 INFO:tasks.workunit.client.0.smithi057.stdout:Running main() from gmock_main.cc 2024-04-24T01:54:21.686 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 38 tests from 2 test suites. 2024-04-24T01:54:21.686 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T01:54:21.686 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 21 tests from LibRadosIoPP 2024-04-24T01:54:21.686 INFO:tasks.workunit.client.0.smithi057.stdout:seed 31580 2024-04-24T01:54:23.679 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoPP.TooBigPP 2024-04-24T01:54:23.679 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIoPP.TooBigPP (0 ms) 2024-04-24T01:54:23.679 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoPP.SimpleWritePP 2024-04-24T01:54:24.043 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIoPP.SimpleWritePP (364 ms) 2024-04-24T01:54:24.043 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoPP.ReadOpPP 2024-04-24T01:54:24.118 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIoPP.ReadOpPP (75 ms) 2024-04-24T01:54:24.118 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoPP.SparseReadOpPP 2024-04-24T01:54:24.138 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIoPP.SparseReadOpPP (21 ms) 2024-04-24T01:54:24.138 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoPP.SparseReadExtentArrayOpPP 2024-04-24T01:54:26.303 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIoPP.SparseReadExtentArrayOpPP (2164 ms) 2024-04-24T01:54:26.303 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoPP.RoundTripPP 2024-04-24T01:54:26.322 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIoPP.RoundTripPP (19 ms) 2024-04-24T01:54:26.322 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoPP.RoundTripPP2 2024-04-24T01:54:26.337 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIoPP.RoundTripPP2 (15 ms) 2024-04-24T01:54:26.338 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoPP.Checksum 2024-04-24T01:54:26.355 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIoPP.Checksum (18 ms) 2024-04-24T01:54:26.355 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-04-24T01:54:26.370 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIoPP.ReadIntoBufferlist (15 ms) 2024-04-24T01:54:26.371 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-04-24T01:54:26.395 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (25 ms) 2024-04-24T01:54:26.395 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-04-24T01:54:26.419 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIoPP.WriteFullRoundTripPP (23 ms) 2024-04-24T01:54:26.419 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-04-24T01:54:26.434 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (16 ms) 2024-04-24T01:54:26.434 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-04-24T01:54:26.463 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIoPP.AppendRoundTripPP (29 ms) 2024-04-24T01:54:26.464 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoPP.TruncTestPP 2024-04-24T01:54:26.487 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIoPP.TruncTestPP (24 ms) 2024-04-24T01:54:26.487 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoPP.RemoveTestPP 2024-04-24T01:54:26.511 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIoPP.RemoveTestPP (24 ms) 2024-04-24T01:54:26.511 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-04-24T01:54:26.541 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIoPP.XattrsRoundTripPP (29 ms) 2024-04-24T01:54:26.541 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoPP.RmXattrPP 2024-04-24T01:54:26.612 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIoPP.RmXattrPP (71 ms) 2024-04-24T01:54:26.612 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoPP.XattrListPP 2024-04-24T01:54:26.646 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIoPP.XattrListPP (34 ms) 2024-04-24T01:54:26.647 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoPP.CmpExtPP 2024-04-24T01:54:26.673 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIoPP.CmpExtPP (26 ms) 2024-04-24T01:54:26.673 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-04-24T01:54:26.689 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIoPP.CmpExtDNEPP (17 ms) 2024-04-24T01:54:26.689 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-04-24T01:54:26.712 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosIoPP.CmpExtMismatchPP (22 ms) 2024-04-24T01:54:27.688 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 21 tests from LibRadosIoPP (3033 ms total) 2024-04-24T01:54:27.689 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:54:27.689 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 17 tests from LibRadosIoECPP 2024-04-24T01:54:27.689 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:373: Skipped 2024-04-24T01:54:27.689 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.689 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoECPP.SimpleWritePP 2024-04-24T01:54:27.689 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:54:27.689 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.689 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:54:27.689 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.689 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.SimpleWritePP (0 ms) 2024-04-24T01:54:27.689 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoECPP.ReadOpPP 2024-04-24T01:54:27.689 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:54:27.690 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.690 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:54:27.690 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.690 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.ReadOpPP (0 ms) 2024-04-24T01:54:27.690 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-04-24T01:54:27.690 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:54:27.690 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.690 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:54:27.690 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.690 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.SparseReadOpPP (0 ms) 2024-04-24T01:54:27.690 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoECPP.RoundTripPP 2024-04-24T01:54:27.690 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:54:27.690 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.690 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:54:27.691 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.691 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP (0 ms) 2024-04-24T01:54:27.691 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoECPP.RoundTripPP2 2024-04-24T01:54:27.691 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:54:27.691 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.691 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:54:27.691 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.691 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP2 (0 ms) 2024-04-24T01:54:27.691 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-04-24T01:54:27.691 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:54:27.691 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.691 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:54:27.691 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.691 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP (0 ms) 2024-04-24T01:54:27.692 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-04-24T01:54:27.692 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:54:27.692 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.692 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:54:27.692 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.692 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP (0 ms) 2024-04-24T01:54:27.692 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-04-24T01:54:27.692 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:54:27.692 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.692 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:54:27.692 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.692 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 (0 ms) 2024-04-24T01:54:27.692 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-04-24T01:54:27.692 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:54:27.692 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.693 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:54:27.693 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.693 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP (0 ms) 2024-04-24T01:54:27.693 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoECPP.TruncTestPP 2024-04-24T01:54:27.693 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:54:27.693 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.693 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:54:27.693 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.693 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.TruncTestPP (0 ms) 2024-04-24T01:54:27.693 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoECPP.RemoveTestPP 2024-04-24T01:54:27.693 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:54:27.693 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.693 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:54:27.693 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.693 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.RemoveTestPP (0 ms) 2024-04-24T01:54:27.694 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-04-24T01:54:27.694 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:54:27.694 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.694 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:54:27.694 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.694 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP (0 ms) 2024-04-24T01:54:27.694 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoECPP.RmXattrPP 2024-04-24T01:54:27.694 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:54:27.694 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.694 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:54:27.694 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.694 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.RmXattrPP (0 ms) 2024-04-24T01:54:27.694 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoECPP.XattrListPP 2024-04-24T01:54:27.694 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:54:27.695 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.695 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:54:27.695 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.695 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.XattrListPP (0 ms) 2024-04-24T01:54:27.695 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoECPP.CmpExtPP 2024-04-24T01:54:27.695 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:54:27.695 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.695 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:54:27.695 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.695 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtPP (0 ms) 2024-04-24T01:54:27.695 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-04-24T01:54:27.695 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:54:27.695 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.695 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:54:27.696 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.696 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP (0 ms) 2024-04-24T01:54:27.696 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-04-24T01:54:27.696 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:54:27.696 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.696 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:54:27.696 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.696 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP (0 ms) 2024-04-24T01:54:27.696 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:381: Skipped 2024-04-24T01:54:27.696 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:27.696 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 17 tests from LibRadosIoECPP (0 ms total) 2024-04-24T01:54:27.696 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:54:27.696 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T01:54:27.696 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 38 tests from 2 test suites ran. (6002 ms total) 2024-04-24T01:54:27.696 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 21 tests. 2024-04-24T01:54:27.697 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] 17 tests, listed below: 2024-04-24T01:54:27.697 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.SimpleWritePP 2024-04-24T01:54:27.697 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.ReadOpPP 2024-04-24T01:54:27.697 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.SparseReadOpPP 2024-04-24T01:54:27.697 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP 2024-04-24T01:54:27.697 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.RoundTripPP2 2024-04-24T01:54:27.697 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-04-24T01:54:27.697 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP 2024-04-24T01:54:27.697 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-04-24T01:54:27.697 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.AppendRoundTripPP 2024-04-24T01:54:27.697 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.TruncTestPP 2024-04-24T01:54:27.697 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.RemoveTestPP 2024-04-24T01:54:27.697 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.XattrsRoundTripPP 2024-04-24T01:54:27.697 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.RmXattrPP 2024-04-24T01:54:27.697 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.XattrListPP 2024-04-24T01:54:27.698 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtPP 2024-04-24T01:54:27.698 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtDNEPP 2024-04-24T01:54:27.698 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosIoECPP.CmpExtMismatchPP 2024-04-24T01:54:27.698 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-24T01:54:27.698 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T01:54:27.698 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_rados_api_asio 2024-04-24T01:54:27.729 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.728+0000 7ff5a67416c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:54:27.738 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.737+0000 7ff5a67416c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:54:27.739 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.738+0000 7ff5a67416c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:54:27.739 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 12 tests from 1 test suite. 2024-04-24T01:54:27.739 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T01:54:27.739 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 12 tests from AsioRados 2024-04-24T01:54:27.740 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.739+0000 7ff5a67416c0 1 Processor -- start 2024-04-24T01:54:27.740 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.739+0000 7ff5a67416c0 1 -- start start 2024-04-24T01:54:27.742 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.741+0000 7ff5a67416c0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x194e510 0x1947f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:54:27.742 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.741+0000 7ff5a67416c0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x18b3950 con 0x194e510 2024-04-24T01:54:27.742 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.741+0000 7ff59b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x194e510 0x1947f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:54:27.743 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.741+0000 7ff59b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x194e510 0x1947f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47430/0 (socket says 172.21.15.57:47430) 2024-04-24T01:54:27.743 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.741+0000 7ff59b7fe640 1 -- 172.21.15.57:0/3916397073 learned_addr learned my addr 172.21.15.57:0/3916397073 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T01:54:27.743 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.742+0000 7ff59b7fe640 1 -- 172.21.15.57:0/3916397073 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x18521e0 con 0x194e510 2024-04-24T01:54:27.744 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.742+0000 7ff59b7fe640 1 --2- 172.21.15.57:0/3916397073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x194e510 0x1947f00 crc :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b63888d39a6f3af server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:54:27.744 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.742+0000 7ff599ffb640 1 -- 172.21.15.57:0/3916397073 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff58c00d500 con 0x194e510 2024-04-24T01:54:27.744 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.742+0000 7ff599ffb640 1 -- 172.21.15.57:0/3916397073 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff58c00d660 con 0x194e510 2024-04-24T01:54:27.744 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.742+0000 7ff599ffb640 1 -- 172.21.15.57:0/3916397073 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff58c00d900 con 0x194e510 2024-04-24T01:54:27.745 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.743+0000 7ff5a67416c0 1 -- 172.21.15.57:0/3916397073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x194e510 msgr2=0x1947f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:54:27.745 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.743+0000 7ff5a67416c0 1 --2- 172.21.15.57:0/3916397073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x194e510 0x1947f00 crc :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:54:27.745 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.743+0000 7ff5a67416c0 1 -- 172.21.15.57:0/3916397073 shutdown_connections 2024-04-24T01:54:27.745 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.743+0000 7ff5a67416c0 1 --2- 172.21.15.57:0/3916397073 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x194e510 0x1947f00 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:54:27.745 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.743+0000 7ff5a67416c0 1 -- 172.21.15.57:0/3916397073 >> 172.21.15.57:0/3916397073 conn(0x186a960 msgr2=0x19e3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:54:27.745 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.743+0000 7ff5a67416c0 1 -- 172.21.15.57:0/3916397073 shutdown_connections 2024-04-24T01:54:27.745 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.743+0000 7ff5a67416c0 1 -- 172.21.15.57:0/3916397073 wait complete. 2024-04-24T01:54:27.746 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.745+0000 7ff5a67416c0 1 Processor -- start 2024-04-24T01:54:27.746 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.745+0000 7ff5a67416c0 1 -- start start 2024-04-24T01:54:27.747 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.746+0000 7ff5a67416c0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x194e510 0x19ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:54:27.748 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.746+0000 7ff5a67416c0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x18b13d0 con 0x194e510 2024-04-24T01:54:27.748 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.746+0000 7ff59b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x194e510 0x19ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:54:27.748 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.746+0000 7ff59b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x194e510 0x19ccf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47444/0 (socket says 172.21.15.57:47444) 2024-04-24T01:54:27.748 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.746+0000 7ff59b7fe640 1 -- 172.21.15.57:0/129378766 learned_addr learned my addr 172.21.15.57:0/129378766 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T01:54:27.748 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.747+0000 7ff59b7fe640 1 -- 172.21.15.57:0/129378766 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1844e30 con 0x194e510 2024-04-24T01:54:27.749 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.747+0000 7ff59b7fe640 1 --2- 172.21.15.57:0/129378766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x194e510 0x19ccf80 crc :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:54:27.749 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.747+0000 7ff598ff9640 1 -- 172.21.15.57:0/129378766 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff58c00fbc0 con 0x194e510 2024-04-24T01:54:27.749 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.747+0000 7ff5a67416c0 1 -- 172.21.15.57:0/129378766 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1844890 con 0x194e510 2024-04-24T01:54:27.749 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.747+0000 7ff598ff9640 1 -- 172.21.15.57:0/129378766 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff58c00fd20 con 0x194e510 2024-04-24T01:54:27.749 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.747+0000 7ff598ff9640 1 -- 172.21.15.57:0/129378766 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff58c00c360 con 0x194e510 2024-04-24T01:54:27.749 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.747+0000 7ff5a67416c0 1 -- 172.21.15.57:0/129378766 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x19e0da0 con 0x194e510 2024-04-24T01:54:27.750 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.749+0000 7ff598ff9640 1 -- 172.21.15.57:0/129378766 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7ff58c00c560 con 0x194e510 2024-04-24T01:54:27.750 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.749+0000 7ff598ff9640 1 --2- 172.21.15.57:0/129378766 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7ff5880371c0 0x7ff5880396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:54:27.751 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.749+0000 7ff598ff9640 1 -- 172.21.15.57:0/129378766 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(235..235 src has 172..235) ==== 2672+0+0 (crc 0 0 0) 0x7ff58c048930 con 0x194e510 2024-04-24T01:54:27.751 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.749+0000 7ff5a67416c0 1 -- 172.21.15.57:0/129378766 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x186d6a0 con 0x194e510 2024-04-24T01:54:27.751 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.749+0000 7ff598ff9640 1 -- 172.21.15.57:0/129378766 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=235) ==== 24+0+0 (crc 0 0 0) 0x7ff58c00b350 con 0x194e510 2024-04-24T01:54:27.751 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.749+0000 7ff59affd640 1 --2- 172.21.15.57:0/129378766 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7ff5880371c0 0x7ff5880396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T01:54:27.751 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.750+0000 7ff5a67416c0 1 -- 172.21.15.57:0/129378766 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- pool_op(create pool 0 tid 1 name ceph_test_rados_api_asio v0) -- 0x18b97b0 con 0x194e510 2024-04-24T01:54:27.751 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:27.750+0000 7ff59affd640 1 --2- 172.21.15.57:0/129378766 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7ff5880371c0 0x7ff5880396d0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:54:28.690 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:28.689+0000 7ff598ff9640 1 -- 172.21.15.57:0/129378766 <== mon.0 v2:172.21.15.57:3300/0 7 ==== pool_op_reply(tid 1 (0) Success v236) ==== 43+0+0 (crc 0 0 0) 0x7ff58c017620 con 0x194e510 2024-04-24T01:54:28.690 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:28.689+0000 7ff598ff9640 1 -- 172.21.15.57:0/129378766 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=236}) -- 0x7ff58803bb40 con 0x194e510 2024-04-24T01:54:28.691 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:28.689+0000 7ff598ff9640 1 -- 172.21.15.57:0/129378766 <== mon.0 v2:172.21.15.57:3300/0 8 ==== osd_map(236..236 src has 185..236) ==== 651+0+0 (crc 0 0 0) 0x7ff58c017410 con 0x194e510 2024-04-24T01:54:28.691 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:28.689+0000 7ff5a67416c0 1 --2- 172.21.15.57:0/129378766 >> v2:172.21.15.57:6805/2600611357 conn(0x194f580 0x1a821f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T01:54:28.691 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:28.689+0000 7ff5a67416c0 1 -- 172.21.15.57:0/129378766 --> v2:172.21.15.57:6805/2600611357 -- osd_op(unknown.0.0:2 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x19ce210 con 0x194f580 2024-04-24T01:54:28.692 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:28.691+0000 7ff59bfff640 1 --2- 172.21.15.57:0/129378766 >> v2:172.21.15.57:6805/2600611357 conn(0x194f580 0x1a821f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T01:54:28.695 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:28.694+0000 7ff59bfff640 1 --2- 172.21.15.57:0/129378766 >> v2:172.21.15.57:6805/2600611357 conn(0x194f580 0x1a821f0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T01:54:29.996 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:29.995+0000 7ff59bfff640 1 -- 172.21.15.57:0/129378766 <== osd.1 v2:172.21.15.57:6805/2600611357 1 ==== osd_op_reply(2 exist [writefull 0~5] v237'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff59400a430 con 0x194f580 2024-04-24T01:54:29.997 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] AsioRados.AsyncReadCallback 2024-04-24T01:54:29.997 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:29.995+0000 7ff5a67416c0 1 -- 172.21.15.57:0/129378766 --> v2:172.21.15.57:6805/2600611357 -- osd_op(unknown.0.0:3 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x19d3dc0 con 0x194f580 2024-04-24T01:54:29.997 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:29.995+0000 7ff5a67416c0 1 -- 172.21.15.57:0/129378766 --> v2:172.21.15.57:6805/2600611357 -- osd_op(unknown.0.0:4 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x1a7d460 con 0x194f580 2024-04-24T01:54:30.006 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.005+0000 7ff59bfff640 1 -- 172.21.15.57:0/129378766 <== osd.1 v2:172.21.15.57:6805/2600611357 2 ==== osd_op_reply(3 exist [read 0~5 out=5b] v237'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7ff59400a430 con 0x194f580 2024-04-24T01:54:30.008 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.007+0000 7ff59bfff640 1 -- 172.21.15.57:0/129378766 <== osd.1 v2:172.21.15.57:6805/2600611357 3 ==== osd_op_reply(4 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff59400a430 con 0x194f580 2024-04-24T01:54:30.009 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] AsioRados.AsyncReadCallback (12 ms) 2024-04-24T01:54:30.009 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] AsioRados.AsyncReadFuture 2024-04-24T01:54:30.009 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.007+0000 7ff5a67416c0 1 -- 172.21.15.57:0/129378766 --> v2:172.21.15.57:6805/2600611357 -- osd_op(unknown.0.0:5 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x19cd4c0 con 0x194f580 2024-04-24T01:54:30.009 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.007+0000 7ff5a67416c0 1 -- 172.21.15.57:0/129378766 --> v2:172.21.15.57:6805/2600611357 -- osd_op(unknown.0.0:6 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x1a82730 con 0x194f580 2024-04-24T01:54:30.021 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.020+0000 7ff59bfff640 1 -- 172.21.15.57:0/129378766 <== osd.1 v2:172.21.15.57:6805/2600611357 4 ==== osd_op_reply(6 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff59400a430 con 0x194f580 2024-04-24T01:54:30.021 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.020+0000 7ff59bfff640 1 -- 172.21.15.57:0/129378766 <== osd.1 v2:172.21.15.57:6805/2600611357 5 ==== osd_op_reply(5 exist [read 0~5 out=5b] v237'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7ff59400a430 con 0x194f580 2024-04-24T01:54:30.022 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] AsioRados.AsyncReadFuture (13 ms) 2024-04-24T01:54:30.022 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] AsioRados.AsyncReadYield 2024-04-24T01:54:30.022 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.020+0000 7ff5a67416c0 1 -- 172.21.15.57:0/129378766 --> v2:172.21.15.57:6805/2600611357 -- osd_op(unknown.0.0:7 75.1 75:8049a5cb:::exist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x1a7d040 con 0x194f580 2024-04-24T01:54:30.022 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.020+0000 7ff5a67416c0 1 -- 172.21.15.57:0/129378766 --> v2:172.21.15.57:6805/2600611357 -- osd_op(unknown.0.0:8 75.1 75:855dde50:::noexist:head [read 0~256] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x1ac3490 con 0x194f580 2024-04-24T01:54:30.034 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.033+0000 7ff59bfff640 1 -- 172.21.15.57:0/129378766 <== osd.1 v2:172.21.15.57:6805/2600611357 6 ==== osd_op_reply(8 noexist [read 0~256] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff59400a430 con 0x194f580 2024-04-24T01:54:30.034 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.033+0000 7ff59bfff640 1 -- 172.21.15.57:0/129378766 <== osd.1 v2:172.21.15.57:6805/2600611357 7 ==== osd_op_reply(7 exist [read 0~5 out=5b] v237'1 uv1 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7ff59400a430 con 0x194f580 2024-04-24T01:54:30.034 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] AsioRados.AsyncReadYield (12 ms) 2024-04-24T01:54:30.034 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] AsioRados.AsyncWriteCallback 2024-04-24T01:54:30.035 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.033+0000 7ff5a67416c0 1 -- 172.21.15.57:0/129378766 --> v2:172.21.15.57:6805/2600611357 -- osd_op(unknown.0.0:9 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x1ac3110 con 0x194f580 2024-04-24T01:54:30.053 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.052+0000 7ff59bfff640 1 -- 172.21.15.57:0/129378766 <== osd.1 v2:172.21.15.57:6805/2600611357 8 ==== osd_op_reply(9 exist [write 0~5] v237'2 uv2 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff59400a430 con 0x194f580 2024-04-24T01:54:30.053 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] AsioRados.AsyncWriteCallback (19 ms) 2024-04-24T01:54:30.053 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] AsioRados.AsyncWriteFuture 2024-04-24T01:54:30.054 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.052+0000 7ff5a67416c0 1 -- 172.21.15.57:0/129378766 --> v2:172.21.15.57:6805/2600611357 -- osd_op(unknown.0.0:10 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x1ac3110 con 0x194f580 2024-04-24T01:54:30.063 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.062+0000 7ff59bfff640 1 -- 172.21.15.57:0/129378766 <== osd.1 v2:172.21.15.57:6805/2600611357 9 ==== osd_op_reply(10 exist [write 0~5] v237'3 uv3 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff59400a430 con 0x194f580 2024-04-24T01:54:30.063 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] AsioRados.AsyncWriteFuture (10 ms) 2024-04-24T01:54:30.063 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] AsioRados.AsyncWriteYield 2024-04-24T01:54:30.063 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.062+0000 7ff5a67416c0 1 -- 172.21.15.57:0/129378766 --> v2:172.21.15.57:6805/2600611357 -- osd_op(unknown.0.0:11 75.1 75:8049a5cb:::exist:head [write 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x1aa5cc0 con 0x194f580 2024-04-24T01:54:30.073 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.072+0000 7ff59bfff640 1 -- 172.21.15.57:0/129378766 <== osd.1 v2:172.21.15.57:6805/2600611357 10 ==== osd_op_reply(11 exist [write 0~5] v237'4 uv4 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff59400a430 con 0x194f580 2024-04-24T01:54:30.073 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] AsioRados.AsyncWriteYield (10 ms) 2024-04-24T01:54:30.073 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] AsioRados.AsyncReadOperationCallback 2024-04-24T01:54:30.073 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.072+0000 7ff5a67416c0 1 -- 172.21.15.57:0/129378766 --> v2:172.21.15.57:6805/2600611357 -- osd_op(unknown.0.0:12 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x1a82a90 con 0x194f580 2024-04-24T01:54:30.074 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.072+0000 7ff5a67416c0 1 -- 172.21.15.57:0/129378766 --> v2:172.21.15.57:6805/2600611357 -- osd_op(unknown.0.0:13 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x1a833f0 con 0x194f580 2024-04-24T01:54:30.080 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.078+0000 7ff59bfff640 1 -- 172.21.15.57:0/129378766 <== osd.1 v2:172.21.15.57:6805/2600611357 11 ==== osd_op_reply(13 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff59400a430 con 0x194f580 2024-04-24T01:54:30.080 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.079+0000 7ff59bfff640 1 -- 172.21.15.57:0/129378766 <== osd.1 v2:172.21.15.57:6805/2600611357 12 ==== osd_op_reply(12 exist [read 0~5 out=5b] v237'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7ff59400a430 con 0x194f580 2024-04-24T01:54:30.080 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] AsioRados.AsyncReadOperationCallback (7 ms) 2024-04-24T01:54:30.080 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] AsioRados.AsyncReadOperationFuture 2024-04-24T01:54:30.080 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.079+0000 7ff5a67416c0 1 -- 172.21.15.57:0/129378766 --> v2:172.21.15.57:6805/2600611357 -- osd_op(unknown.0.0:14 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x1a82f40 con 0x194f580 2024-04-24T01:54:30.080 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.079+0000 7ff5a67416c0 1 -- 172.21.15.57:0/129378766 --> v2:172.21.15.57:6805/2600611357 -- osd_op(unknown.0.0:15 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x1aa6370 con 0x194f580 2024-04-24T01:54:30.085 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.084+0000 7ff59bfff640 1 -- 172.21.15.57:0/129378766 <== osd.1 v2:172.21.15.57:6805/2600611357 13 ==== osd_op_reply(15 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff59400a430 con 0x194f580 2024-04-24T01:54:30.085 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.084+0000 7ff59bfff640 1 -- 172.21.15.57:0/129378766 <== osd.1 v2:172.21.15.57:6805/2600611357 14 ==== osd_op_reply(14 exist [read 0~5 out=5b] v237'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7ff59400a430 con 0x194f580 2024-04-24T01:54:30.086 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] AsioRados.AsyncReadOperationFuture (6 ms) 2024-04-24T01:54:30.086 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] AsioRados.AsyncReadOperationYield 2024-04-24T01:54:30.086 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.085+0000 7ff5a67416c0 1 -- 172.21.15.57:0/129378766 --> v2:172.21.15.57:6805/2600611357 -- osd_op(unknown.0.0:16 75.1 75:8049a5cb:::exist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x1a834f0 con 0x194f580 2024-04-24T01:54:30.086 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.085+0000 7ff5a67416c0 1 -- 172.21.15.57:0/129378766 --> v2:172.21.15.57:6805/2600611357 -- osd_op(unknown.0.0:17 75.1 75:855dde50:::noexist:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e236) -- 0x1aa5b00 con 0x194f580 2024-04-24T01:54:30.091 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.090+0000 7ff59bfff640 1 -- 172.21.15.57:0/129378766 <== osd.1 v2:172.21.15.57:6805/2600611357 15 ==== osd_op_reply(16 exist [read 0~5 out=5b] v237'4 uv4 ondisk = 0) ==== 149+0+5 (crc 0 0 0) 0x7ff59400a430 con 0x194f580 2024-04-24T01:54:30.092 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.091+0000 7ff59bfff640 1 -- 172.21.15.57:0/129378766 <== osd.1 v2:172.21.15.57:6805/2600611357 16 ==== osd_op_reply(17 noexist [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7ff59400a430 con 0x194f580 2024-04-24T01:54:30.092 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] AsioRados.AsyncReadOperationYield (6 ms) 2024-04-24T01:54:30.092 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] AsioRados.AsyncWriteOperationCallback 2024-04-24T01:54:30.092 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.091+0000 7ff5a67416c0 1 -- 172.21.15.57:0/129378766 --> v2:172.21.15.57:6805/2600611357 -- osd_op(unknown.0.0:18 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x1a834f0 con 0x194f580 2024-04-24T01:54:30.101 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.100+0000 7ff59bfff640 1 -- 172.21.15.57:0/129378766 <== osd.1 v2:172.21.15.57:6805/2600611357 17 ==== osd_op_reply(18 exist [writefull 0~5] v237'5 uv5 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff59400a430 con 0x194f580 2024-04-24T01:54:30.101 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] AsioRados.AsyncWriteOperationCallback (10 ms) 2024-04-24T01:54:30.102 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] AsioRados.AsyncWriteOperationFuture 2024-04-24T01:54:30.102 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.100+0000 7ff5a67416c0 1 -- 172.21.15.57:0/129378766 --> v2:172.21.15.57:6805/2600611357 -- osd_op(unknown.0.0:19 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x1a834f0 con 0x194f580 2024-04-24T01:54:30.110 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.110+0000 7ff59bfff640 1 -- 172.21.15.57:0/129378766 <== osd.1 v2:172.21.15.57:6805/2600611357 18 ==== osd_op_reply(19 exist [writefull 0~5] v237'6 uv6 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff59400a430 con 0x194f580 2024-04-24T01:54:30.111 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] AsioRados.AsyncWriteOperationFuture (9 ms) 2024-04-24T01:54:30.111 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] AsioRados.AsyncWriteOperationYield 2024-04-24T01:54:30.111 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.110+0000 7ff5a67416c0 1 -- 172.21.15.57:0/129378766 --> v2:172.21.15.57:6805/2600611357 -- osd_op(unknown.0.0:20 75.1 75:8049a5cb:::exist:head [writefull 0~5 in=5b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e236) -- 0x1a7d7f0 con 0x194f580 2024-04-24T01:54:30.120 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.119+0000 7ff59bfff640 1 -- 172.21.15.57:0/129378766 <== osd.1 v2:172.21.15.57:6805/2600611357 19 ==== osd_op_reply(20 exist [writefull 0~5] v237'7 uv7 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7ff59400a430 con 0x194f580 2024-04-24T01:54:30.120 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] AsioRados.AsyncWriteOperationYield (9 ms) 2024-04-24T01:54:30.121 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.119+0000 7ff5a67416c0 1 -- 172.21.15.57:0/129378766 >> v2:172.21.15.57:6805/2600611357 conn(0x194f580 msgr2=0x1a821f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:54:30.121 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.119+0000 7ff5a67416c0 1 --2- 172.21.15.57:0/129378766 >> v2:172.21.15.57:6805/2600611357 conn(0x194f580 0x1a821f0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:54:30.121 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.119+0000 7ff5a67416c0 1 -- 172.21.15.57:0/129378766 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7ff5880371c0 msgr2=0x7ff5880396d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:54:30.122 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.119+0000 7ff5a67416c0 1 --2- 172.21.15.57:0/129378766 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7ff5880371c0 0x7ff5880396d0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:54:30.122 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.119+0000 7ff5a67416c0 1 -- 172.21.15.57:0/129378766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x194e510 msgr2=0x19ccf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T01:54:30.122 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.119+0000 7ff5a67416c0 1 --2- 172.21.15.57:0/129378766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x194e510 0x19ccf80 crc :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:54:30.122 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.119+0000 7ff5a67416c0 1 -- 172.21.15.57:0/129378766 shutdown_connections 2024-04-24T01:54:30.122 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.119+0000 7ff5a67416c0 1 --2- 172.21.15.57:0/129378766 >> v2:172.21.15.57:6805/2600611357 conn(0x194f580 0x1a821f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:54:30.122 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.119+0000 7ff5a67416c0 1 --2- 172.21.15.57:0/129378766 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7ff5880371c0 0x7ff5880396d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:54:30.122 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.119+0000 7ff5a67416c0 1 --2- 172.21.15.57:0/129378766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x194e510 0x19ccf80 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T01:54:30.122 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.119+0000 7ff5a67416c0 1 -- 172.21.15.57:0/129378766 >> 172.21.15.57:0/129378766 conn(0x186a960 msgr2=0x19e32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T01:54:30.122 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.119+0000 7ff5a67416c0 1 -- 172.21.15.57:0/129378766 shutdown_connections 2024-04-24T01:54:30.122 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.119+0000 7ff5a67416c0 1 -- 172.21.15.57:0/129378766 wait complete. 2024-04-24T01:54:30.122 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 12 tests from AsioRados (123 ms total) 2024-04-24T01:54:30.123 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:54:30.123 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T01:54:30.123 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 12 tests from 1 test suite ran. (2382 ms total) 2024-04-24T01:54:30.123 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 12 tests. 2024-04-24T01:54:30.123 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-24T01:54:30.123 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T01:54:30.123 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_rados_api_list 2024-04-24T01:54:30.153 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.152+0000 7fb5168679c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:54:30.153 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.152+0000 7fb5168679c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:54:30.153 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:30.152+0000 7fb5168679c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:54:30.153 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 11 tests from 3 test suites. 2024-04-24T01:54:30.154 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T01:54:30.154 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 7 tests from LibRadosList 2024-04-24T01:54:31.704 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosList.ListObjects 2024-04-24T01:54:32.307 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosList.ListObjects (603 ms) 2024-04-24T01:54:32.307 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosList.ListObjectsZeroInName 2024-04-24T01:54:32.498 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosList.ListObjectsZeroInName (191 ms) 2024-04-24T01:54:32.498 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosList.ListObjectsNS 2024-04-24T01:54:32.579 INFO:tasks.workunit.client.0.smithi057.stdout:myset foo1,foo2,foo3 2024-04-24T01:54:32.667 INFO:tasks.workunit.client.0.smithi057.stdout:foo1 2024-04-24T01:54:32.667 INFO:tasks.workunit.client.0.smithi057.stdout:foo2 2024-04-24T01:54:32.667 INFO:tasks.workunit.client.0.smithi057.stdout:foo3 2024-04-24T01:54:32.667 INFO:tasks.workunit.client.0.smithi057.stdout:myset foo1,foo4,foo5 2024-04-24T01:54:32.800 INFO:tasks.workunit.client.0.smithi057.stdout:foo4 2024-04-24T01:54:32.801 INFO:tasks.workunit.client.0.smithi057.stdout:foo5 2024-04-24T01:54:32.801 INFO:tasks.workunit.client.0.smithi057.stdout:foo1 2024-04-24T01:54:32.801 INFO:tasks.workunit.client.0.smithi057.stdout:myset foo6,foo7 2024-04-24T01:54:32.888 INFO:tasks.workunit.client.0.smithi057.stdout:foo7 2024-04-24T01:54:32.888 INFO:tasks.workunit.client.0.smithi057.stdout:foo6 2024-04-24T01:54:32.888 INFO:tasks.workunit.client.0.smithi057.stdout:myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-04-24T01:54:32.975 INFO:tasks.workunit.client.0.smithi057.stdout:ns1:foo4 2024-04-24T01:54:32.975 INFO:tasks.workunit.client.0.smithi057.stdout:ns1:foo5 2024-04-24T01:54:32.975 INFO:tasks.workunit.client.0.smithi057.stdout:ns2:foo7 2024-04-24T01:54:32.975 INFO:tasks.workunit.client.0.smithi057.stdout:ns2:foo6 2024-04-24T01:54:32.975 INFO:tasks.workunit.client.0.smithi057.stdout:ns1:foo1 2024-04-24T01:54:32.975 INFO:tasks.workunit.client.0.smithi057.stdout::foo1 2024-04-24T01:54:32.975 INFO:tasks.workunit.client.0.smithi057.stdout::foo2 2024-04-24T01:54:32.975 INFO:tasks.workunit.client.0.smithi057.stdout::foo3 2024-04-24T01:54:33.135 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosList.ListObjectsNS (636 ms) 2024-04-24T01:54:33.135 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosList.ListObjectsStart 2024-04-24T01:54:33.377 INFO:tasks.workunit.client.0.smithi057.stdout:1 0 2024-04-24T01:54:33.377 INFO:tasks.workunit.client.0.smithi057.stdout:10 0 2024-04-24T01:54:33.377 INFO:tasks.workunit.client.0.smithi057.stdout:13 0 2024-04-24T01:54:33.377 INFO:tasks.workunit.client.0.smithi057.stdout:7 0 2024-04-24T01:54:33.377 INFO:tasks.workunit.client.0.smithi057.stdout:14 0 2024-04-24T01:54:33.377 INFO:tasks.workunit.client.0.smithi057.stdout:0 0 2024-04-24T01:54:33.377 INFO:tasks.workunit.client.0.smithi057.stdout:15 0 2024-04-24T01:54:33.377 INFO:tasks.workunit.client.0.smithi057.stdout:11 0 2024-04-24T01:54:33.377 INFO:tasks.workunit.client.0.smithi057.stdout:5 0 2024-04-24T01:54:33.377 INFO:tasks.workunit.client.0.smithi057.stdout:8 0 2024-04-24T01:54:33.378 INFO:tasks.workunit.client.0.smithi057.stdout:6 0 2024-04-24T01:54:33.378 INFO:tasks.workunit.client.0.smithi057.stdout:3 0 2024-04-24T01:54:33.378 INFO:tasks.workunit.client.0.smithi057.stdout:4 0 2024-04-24T01:54:33.378 INFO:tasks.workunit.client.0.smithi057.stdout:12 0 2024-04-24T01:54:33.378 INFO:tasks.workunit.client.0.smithi057.stdout:9 0 2024-04-24T01:54:33.378 INFO:tasks.workunit.client.0.smithi057.stdout:2 0 2024-04-24T01:54:33.466 INFO:tasks.workunit.client.0.smithi057.stdout:have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-04-24T01:54:33.695 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosList.ListObjectsStart (560 ms) 2024-04-24T01:54:33.695 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosList.ListObjectsCursor 2024-04-24T01:54:33.845 INFO:tasks.workunit.client.0.smithi057.stdout:x cursor=MIN 2024-04-24T01:54:33.935 INFO:tasks.workunit.client.0.smithi057.stdout:> oid=1 cursor=76:02547ec2:::1:head 2024-04-24T01:54:33.935 INFO:tasks.workunit.client.0.smithi057.stdout:> oid=10 cursor=76:52ea6a34:::10:head 2024-04-24T01:54:33.935 INFO:tasks.workunit.client.0.smithi057.stdout:> oid=13 cursor=76:566253c9:::13:head 2024-04-24T01:54:33.935 INFO:tasks.workunit.client.0.smithi057.stdout:> oid=7 cursor=76:5c6b0b28:::7:head 2024-04-24T01:54:33.935 INFO:tasks.workunit.client.0.smithi057.stdout:> oid=14 cursor=76:62a1935d:::14:head 2024-04-24T01:54:33.935 INFO:tasks.workunit.client.0.smithi057.stdout:> oid=0 cursor=76:6cac518f:::0:head 2024-04-24T01:54:33.935 INFO:tasks.workunit.client.0.smithi057.stdout:> oid=15 cursor=76:863748b0:::15:head 2024-04-24T01:54:33.936 INFO:tasks.workunit.client.0.smithi057.stdout:> oid=11 cursor=76:89d3ae78:::11:head 2024-04-24T01:54:33.936 INFO:tasks.workunit.client.0.smithi057.stdout:> oid=5 cursor=76:b29083e3:::5:head 2024-04-24T01:54:33.936 INFO:tasks.workunit.client.0.smithi057.stdout:> oid=8 cursor=76:bd63b0f1:::8:head 2024-04-24T01:54:33.936 INFO:tasks.workunit.client.0.smithi057.stdout:> oid=6 cursor=76:c4fdafeb:::6:head 2024-04-24T01:54:33.936 INFO:tasks.workunit.client.0.smithi057.stdout:> oid=3 cursor=76:cfc208b3:::3:head 2024-04-24T01:54:33.936 INFO:tasks.workunit.client.0.smithi057.stdout:> oid=4 cursor=76:d83876eb:::4:head 2024-04-24T01:54:33.936 INFO:tasks.workunit.client.0.smithi057.stdout:> oid=12 cursor=76:de5d7c5f:::12:head 2024-04-24T01:54:33.936 INFO:tasks.workunit.client.0.smithi057.stdout:> oid=9 cursor=76:e960b815:::9:head 2024-04-24T01:54:33.936 INFO:tasks.workunit.client.0.smithi057.stdout:> oid=2 cursor=76:f905c69b:::2:head 2024-04-24T01:54:34.149 INFO:tasks.workunit.client.0.smithi057.stdout:FIRST> seek to MIN oid=1 2024-04-24T01:54:34.236 INFO:tasks.workunit.client.0.smithi057.stdout:: oid=1 cursor=76:02547ec2:::1:head 2024-04-24T01:54:34.236 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:02547ec2:::1:head 2024-04-24T01:54:34.322 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:02547ec2:::1:head -> 1 2024-04-24T01:54:34.323 INFO:tasks.workunit.client.0.smithi057.stdout:: oid=10 cursor=76:52ea6a34:::10:head 2024-04-24T01:54:34.323 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:52ea6a34:::10:head 2024-04-24T01:54:34.382 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:52ea6a34:::10:head -> 10 2024-04-24T01:54:34.382 INFO:tasks.workunit.client.0.smithi057.stdout:: oid=13 cursor=76:566253c9:::13:head 2024-04-24T01:54:34.382 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:566253c9:::13:head 2024-04-24T01:54:34.441 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:566253c9:::13:head -> 13 2024-04-24T01:54:34.441 INFO:tasks.workunit.client.0.smithi057.stdout:: oid=7 cursor=76:5c6b0b28:::7:head 2024-04-24T01:54:34.441 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:5c6b0b28:::7:head 2024-04-24T01:54:34.497 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:5c6b0b28:::7:head -> 7 2024-04-24T01:54:34.498 INFO:tasks.workunit.client.0.smithi057.stdout:: oid=14 cursor=76:62a1935d:::14:head 2024-04-24T01:54:34.498 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:62a1935d:::14:head 2024-04-24T01:54:34.553 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:62a1935d:::14:head -> 14 2024-04-24T01:54:34.553 INFO:tasks.workunit.client.0.smithi057.stdout:: oid=0 cursor=76:6cac518f:::0:head 2024-04-24T01:54:34.553 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:6cac518f:::0:head 2024-04-24T01:54:34.605 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:6cac518f:::0:head -> 0 2024-04-24T01:54:34.605 INFO:tasks.workunit.client.0.smithi057.stdout:: oid=15 cursor=76:863748b0:::15:head 2024-04-24T01:54:34.605 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:863748b0:::15:head 2024-04-24T01:54:34.648 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:863748b0:::15:head -> 15 2024-04-24T01:54:34.648 INFO:tasks.workunit.client.0.smithi057.stdout:: oid=11 cursor=76:89d3ae78:::11:head 2024-04-24T01:54:34.649 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:89d3ae78:::11:head 2024-04-24T01:54:34.693 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:89d3ae78:::11:head -> 11 2024-04-24T01:54:34.693 INFO:tasks.workunit.client.0.smithi057.stdout:: oid=5 cursor=76:b29083e3:::5:head 2024-04-24T01:54:34.693 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:b29083e3:::5:head 2024-04-24T01:54:34.720 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:b29083e3:::5:head -> 5 2024-04-24T01:54:34.721 INFO:tasks.workunit.client.0.smithi057.stdout:: oid=8 cursor=76:bd63b0f1:::8:head 2024-04-24T01:54:34.721 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:bd63b0f1:::8:head 2024-04-24T01:54:34.745 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:bd63b0f1:::8:head -> 8 2024-04-24T01:54:34.745 INFO:tasks.workunit.client.0.smithi057.stdout:: oid=6 cursor=76:c4fdafeb:::6:head 2024-04-24T01:54:34.745 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:c4fdafeb:::6:head 2024-04-24T01:54:34.766 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:c4fdafeb:::6:head -> 6 2024-04-24T01:54:34.766 INFO:tasks.workunit.client.0.smithi057.stdout:: oid=3 cursor=76:cfc208b3:::3:head 2024-04-24T01:54:34.766 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:cfc208b3:::3:head 2024-04-24T01:54:34.785 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:cfc208b3:::3:head -> 3 2024-04-24T01:54:34.785 INFO:tasks.workunit.client.0.smithi057.stdout:: oid=4 cursor=76:d83876eb:::4:head 2024-04-24T01:54:34.785 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:d83876eb:::4:head 2024-04-24T01:54:34.798 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:d83876eb:::4:head -> 4 2024-04-24T01:54:34.798 INFO:tasks.workunit.client.0.smithi057.stdout:: oid=12 cursor=76:de5d7c5f:::12:head 2024-04-24T01:54:34.798 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:de5d7c5f:::12:head 2024-04-24T01:54:34.812 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:de5d7c5f:::12:head -> 12 2024-04-24T01:54:34.812 INFO:tasks.workunit.client.0.smithi057.stdout:: oid=9 cursor=76:e960b815:::9:head 2024-04-24T01:54:34.812 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:e960b815:::9:head 2024-04-24T01:54:34.820 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:e960b815:::9:head -> 9 2024-04-24T01:54:34.820 INFO:tasks.workunit.client.0.smithi057.stdout:: oid=2 cursor=76:f905c69b:::2:head 2024-04-24T01:54:34.820 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:f905c69b:::2:head 2024-04-24T01:54:34.822 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:f905c69b:::2:head -> 2 2024-04-24T01:54:34.822 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:02547ec2:::1:head 2024-04-24T01:54:34.823 INFO:tasks.workunit.client.0.smithi057.stdout:: cursor()=76:02547ec2:::1:head expected=76:02547ec2:::1:head 2024-04-24T01:54:34.910 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:02547ec2:::1:head -> 1 2024-04-24T01:54:34.910 INFO:tasks.workunit.client.0.smithi057.stdout:: entry=1 expected=1 2024-04-24T01:54:34.910 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:f905c69b:::2:head 2024-04-24T01:54:34.910 INFO:tasks.workunit.client.0.smithi057.stdout:: cursor()=76:f905c69b:::2:head expected=76:f905c69b:::2:head 2024-04-24T01:54:34.913 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:f905c69b:::2:head -> 2 2024-04-24T01:54:34.913 INFO:tasks.workunit.client.0.smithi057.stdout:: entry=2 expected=2 2024-04-24T01:54:34.913 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:cfc208b3:::3:head 2024-04-24T01:54:34.913 INFO:tasks.workunit.client.0.smithi057.stdout:: cursor()=76:cfc208b3:::3:head expected=76:cfc208b3:::3:head 2024-04-24T01:54:34.932 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:cfc208b3:::3:head -> 3 2024-04-24T01:54:34.932 INFO:tasks.workunit.client.0.smithi057.stdout:: entry=3 expected=3 2024-04-24T01:54:34.932 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:c4fdafeb:::6:head 2024-04-24T01:54:34.932 INFO:tasks.workunit.client.0.smithi057.stdout:: cursor()=76:c4fdafeb:::6:head expected=76:c4fdafeb:::6:head 2024-04-24T01:54:34.954 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:c4fdafeb:::6:head -> 6 2024-04-24T01:54:34.954 INFO:tasks.workunit.client.0.smithi057.stdout:: entry=6 expected=6 2024-04-24T01:54:34.954 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:bd63b0f1:::8:head 2024-04-24T01:54:34.954 INFO:tasks.workunit.client.0.smithi057.stdout:: cursor()=76:bd63b0f1:::8:head expected=76:bd63b0f1:::8:head 2024-04-24T01:54:34.978 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:bd63b0f1:::8:head -> 8 2024-04-24T01:54:34.978 INFO:tasks.workunit.client.0.smithi057.stdout:: entry=8 expected=8 2024-04-24T01:54:34.978 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:b29083e3:::5:head 2024-04-24T01:54:34.978 INFO:tasks.workunit.client.0.smithi057.stdout:: cursor()=76:b29083e3:::5:head expected=76:b29083e3:::5:head 2024-04-24T01:54:35.006 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:b29083e3:::5:head -> 5 2024-04-24T01:54:35.006 INFO:tasks.workunit.client.0.smithi057.stdout:: entry=5 expected=5 2024-04-24T01:54:35.007 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:89d3ae78:::11:head 2024-04-24T01:54:35.007 INFO:tasks.workunit.client.0.smithi057.stdout:: cursor()=76:89d3ae78:::11:head expected=76:89d3ae78:::11:head 2024-04-24T01:54:35.051 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:89d3ae78:::11:head -> 11 2024-04-24T01:54:35.051 INFO:tasks.workunit.client.0.smithi057.stdout:: entry=11 expected=11 2024-04-24T01:54:35.051 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:863748b0:::15:head 2024-04-24T01:54:35.051 INFO:tasks.workunit.client.0.smithi057.stdout:: cursor()=76:863748b0:::15:head expected=76:863748b0:::15:head 2024-04-24T01:54:35.095 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:863748b0:::15:head -> 15 2024-04-24T01:54:35.095 INFO:tasks.workunit.client.0.smithi057.stdout:: entry=15 expected=15 2024-04-24T01:54:35.095 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:6cac518f:::0:head 2024-04-24T01:54:35.095 INFO:tasks.workunit.client.0.smithi057.stdout:: cursor()=76:6cac518f:::0:head expected=76:6cac518f:::0:head 2024-04-24T01:54:35.147 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:6cac518f:::0:head -> 0 2024-04-24T01:54:35.147 INFO:tasks.workunit.client.0.smithi057.stdout:: entry=0 expected=0 2024-04-24T01:54:35.147 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:62a1935d:::14:head 2024-04-24T01:54:35.147 INFO:tasks.workunit.client.0.smithi057.stdout:: cursor()=76:62a1935d:::14:head expected=76:62a1935d:::14:head 2024-04-24T01:54:35.203 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:62a1935d:::14:head -> 14 2024-04-24T01:54:35.203 INFO:tasks.workunit.client.0.smithi057.stdout:: entry=14 expected=14 2024-04-24T01:54:35.203 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:5c6b0b28:::7:head 2024-04-24T01:54:35.203 INFO:tasks.workunit.client.0.smithi057.stdout:: cursor()=76:5c6b0b28:::7:head expected=76:5c6b0b28:::7:head 2024-04-24T01:54:35.261 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:5c6b0b28:::7:head -> 7 2024-04-24T01:54:35.261 INFO:tasks.workunit.client.0.smithi057.stdout:: entry=7 expected=7 2024-04-24T01:54:35.261 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:52ea6a34:::10:head 2024-04-24T01:54:35.261 INFO:tasks.workunit.client.0.smithi057.stdout:: cursor()=76:52ea6a34:::10:head expected=76:52ea6a34:::10:head 2024-04-24T01:54:35.334 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:52ea6a34:::10:head -> 10 2024-04-24T01:54:35.334 INFO:tasks.workunit.client.0.smithi057.stdout:: entry=10 expected=10 2024-04-24T01:54:35.334 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:e960b815:::9:head 2024-04-24T01:54:35.334 INFO:tasks.workunit.client.0.smithi057.stdout:: cursor()=76:e960b815:::9:head expected=76:e960b815:::9:head 2024-04-24T01:54:35.341 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:e960b815:::9:head -> 9 2024-04-24T01:54:35.341 INFO:tasks.workunit.client.0.smithi057.stdout:: entry=9 expected=9 2024-04-24T01:54:35.341 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:de5d7c5f:::12:head 2024-04-24T01:54:35.341 INFO:tasks.workunit.client.0.smithi057.stdout:: cursor()=76:de5d7c5f:::12:head expected=76:de5d7c5f:::12:head 2024-04-24T01:54:35.355 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:de5d7c5f:::12:head -> 12 2024-04-24T01:54:35.355 INFO:tasks.workunit.client.0.smithi057.stdout:: entry=12 expected=12 2024-04-24T01:54:35.355 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:d83876eb:::4:head 2024-04-24T01:54:35.355 INFO:tasks.workunit.client.0.smithi057.stdout:: cursor()=76:d83876eb:::4:head expected=76:d83876eb:::4:head 2024-04-24T01:54:35.368 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:d83876eb:::4:head -> 4 2024-04-24T01:54:35.369 INFO:tasks.workunit.client.0.smithi057.stdout:: entry=4 expected=4 2024-04-24T01:54:35.369 INFO:tasks.workunit.client.0.smithi057.stdout:: seek to 76:566253c9:::13:head 2024-04-24T01:54:35.369 INFO:tasks.workunit.client.0.smithi057.stdout:: cursor()=76:566253c9:::13:head expected=76:566253c9:::13:head 2024-04-24T01:54:35.429 INFO:tasks.workunit.client.0.smithi057.stdout:> 76:566253c9:::13:head -> 13 2024-04-24T01:54:35.429 INFO:tasks.workunit.client.0.smithi057.stdout:: entry=13 expected=13 2024-04-24T01:54:35.661 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosList.ListObjectsCursor (1966 ms) 2024-04-24T01:54:35.661 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosList.EnumerateObjects 2024-04-24T01:54:36.132 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosList.EnumerateObjects (472 ms) 2024-04-24T01:54:36.132 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosList.EnumerateObjectsSplit 2024-04-24T01:54:36.282 INFO:tasks.workunit.client.0.smithi057.stdout:split 0/5 -> MIN 76:33333333::::head 2024-04-24T01:54:36.302 INFO:tasks.workunit.client.0.smithi057.stdout:split 1/5 -> 76:33333333::::head 76:66666666::::head 2024-04-24T01:54:36.321 INFO:tasks.workunit.client.0.smithi057.stdout:split 2/5 -> 76:66666666::::head 76:99999999::::head 2024-04-24T01:54:36.342 INFO:tasks.workunit.client.0.smithi057.stdout:split 3/5 -> 76:99999999::::head 76:cccccccc::::head 2024-04-24T01:54:36.361 INFO:tasks.workunit.client.0.smithi057.stdout:split 4/5 -> 76:cccccccc::::head MAX 2024-04-24T01:54:36.614 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosList.EnumerateObjectsSplit (481 ms) 2024-04-24T01:54:36.751 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 7 tests from LibRadosList (4910 ms total) 2024-04-24T01:54:36.751 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:54:36.751 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 3 tests from LibRadosListEC 2024-04-24T01:54:36.751 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:70: Skipped 2024-04-24T01:54:36.751 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:36.751 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosListEC.ListObjects 2024-04-24T01:54:36.751 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:84: Skipped 2024-04-24T01:54:36.752 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:36.752 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:96: Skipped 2024-04-24T01:54:36.752 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:36.752 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosListEC.ListObjects (0 ms) 2024-04-24T01:54:36.752 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosListEC.ListObjectsNS 2024-04-24T01:54:36.752 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:84: Skipped 2024-04-24T01:54:36.752 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:36.752 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:96: Skipped 2024-04-24T01:54:36.752 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:36.752 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsNS (0 ms) 2024-04-24T01:54:36.752 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosListEC.ListObjectsStart 2024-04-24T01:54:36.752 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:84: Skipped 2024-04-24T01:54:36.752 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:36.752 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:96: Skipped 2024-04-24T01:54:36.753 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:36.753 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsStart (0 ms) 2024-04-24T01:54:36.753 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:78: Skipped 2024-04-24T01:54:36.753 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:36.753 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 3 tests from LibRadosListEC (0 ms total) 2024-04-24T01:54:36.753 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:54:36.753 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 1 test from LibRadosListNP 2024-04-24T01:54:36.753 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosListNP.ListObjectsError 2024-04-24T01:54:39.774 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosListNP.ListObjectsError (3023 ms) 2024-04-24T01:54:39.777 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 1 test from LibRadosListNP (3023 ms total) 2024-04-24T01:54:39.778 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:54:39.778 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T01:54:39.778 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 11 tests from 3 test suites ran. (9620 ms total) 2024-04-24T01:54:39.778 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 8 tests. 2024-04-24T01:54:39.778 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] 3 tests, listed below: 2024-04-24T01:54:39.778 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosListEC.ListObjects 2024-04-24T01:54:39.778 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsNS 2024-04-24T01:54:39.778 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosListEC.ListObjectsStart 2024-04-24T01:54:39.779 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-24T01:54:39.779 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T01:54:39.779 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_rados_api_lock 2024-04-24T01:54:39.797 INFO:tasks.workunit.client.0.smithi057.stdout:Running main() from gmock_main.cc 2024-04-24T01:54:39.797 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 16 tests from 2 test suites. 2024-04-24T01:54:39.797 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T01:54:39.797 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 8 tests from LibRadosLock 2024-04-24T01:54:41.788 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLock.LockExclusive 2024-04-24T01:54:42.185 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosLock.LockExclusive (397 ms) 2024-04-24T01:54:42.185 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLock.LockShared 2024-04-24T01:54:42.210 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosLock.LockShared (26 ms) 2024-04-24T01:54:42.211 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLock.LockExclusiveDur 2024-04-24T01:54:43.250 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosLock.LockExclusiveDur (1037 ms) 2024-04-24T01:54:43.250 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLock.LockSharedDur 2024-04-24T01:54:44.283 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosLock.LockSharedDur (1036 ms) 2024-04-24T01:54:44.284 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLock.LockMayRenew 2024-04-24T01:54:44.326 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosLock.LockMayRenew (43 ms) 2024-04-24T01:54:44.327 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLock.Unlock 2024-04-24T01:54:44.363 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosLock.Unlock (37 ms) 2024-04-24T01:54:44.364 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLock.ListLockers 2024-04-24T01:54:44.413 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosLock.ListLockers (49 ms) 2024-04-24T01:54:44.413 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLock.BreakLock 2024-04-24T01:54:44.441 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosLock.BreakLock (29 ms) 2024-04-24T01:54:44.819 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 8 tests from LibRadosLock (2654 ms total) 2024-04-24T01:54:44.819 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:54:44.820 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 8 tests from LibRadosLockEC 2024-04-24T01:54:44.820 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:168: Skipped 2024-04-24T01:54:44.820 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:44.820 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLockEC.LockExclusive 2024-04-24T01:54:44.820 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:182: Skipped 2024-04-24T01:54:44.820 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:44.820 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:196: Skipped 2024-04-24T01:54:44.820 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:44.820 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusive (0 ms) 2024-04-24T01:54:44.820 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLockEC.LockShared 2024-04-24T01:54:44.820 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:182: Skipped 2024-04-24T01:54:44.820 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:44.820 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:196: Skipped 2024-04-24T01:54:44.821 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:44.821 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockEC.LockShared (0 ms) 2024-04-24T01:54:44.821 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLockEC.LockExclusiveDur 2024-04-24T01:54:44.821 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:182: Skipped 2024-04-24T01:54:44.821 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:44.821 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:196: Skipped 2024-04-24T01:54:44.821 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:44.821 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusiveDur (0 ms) 2024-04-24T01:54:44.821 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLockEC.LockSharedDur 2024-04-24T01:54:44.821 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:182: Skipped 2024-04-24T01:54:44.821 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:44.821 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:196: Skipped 2024-04-24T01:54:44.821 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:44.821 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockEC.LockSharedDur (0 ms) 2024-04-24T01:54:44.822 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLockEC.LockMayRenew 2024-04-24T01:54:44.822 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:182: Skipped 2024-04-24T01:54:44.822 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:44.822 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:196: Skipped 2024-04-24T01:54:44.822 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:44.822 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockEC.LockMayRenew (0 ms) 2024-04-24T01:54:44.822 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLockEC.Unlock 2024-04-24T01:54:44.822 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:182: Skipped 2024-04-24T01:54:44.822 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:44.822 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:196: Skipped 2024-04-24T01:54:44.822 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:44.822 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockEC.Unlock (0 ms) 2024-04-24T01:54:44.822 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLockEC.ListLockers 2024-04-24T01:54:44.822 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:182: Skipped 2024-04-24T01:54:44.823 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:44.823 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:196: Skipped 2024-04-24T01:54:44.823 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:44.823 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockEC.ListLockers (0 ms) 2024-04-24T01:54:44.823 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLockEC.BreakLock 2024-04-24T01:54:44.823 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:182: Skipped 2024-04-24T01:54:44.823 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:44.823 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:196: Skipped 2024-04-24T01:54:44.823 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:44.823 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockEC.BreakLock (0 ms) 2024-04-24T01:54:44.823 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:176: Skipped 2024-04-24T01:54:44.823 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:44.823 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 8 tests from LibRadosLockEC (0 ms total) 2024-04-24T01:54:44.823 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:54:44.823 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T01:54:44.824 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 16 tests from 2 test suites ran. (5021 ms total) 2024-04-24T01:54:44.824 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 8 tests. 2024-04-24T01:54:44.824 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] 8 tests, listed below: 2024-04-24T01:54:44.824 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusive 2024-04-24T01:54:44.824 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockEC.LockShared 2024-04-24T01:54:44.824 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockEC.LockExclusiveDur 2024-04-24T01:54:44.824 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockEC.LockSharedDur 2024-04-24T01:54:44.824 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockEC.LockMayRenew 2024-04-24T01:54:44.824 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockEC.Unlock 2024-04-24T01:54:44.824 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockEC.ListLockers 2024-04-24T01:54:44.824 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockEC.BreakLock 2024-04-24T01:54:44.825 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-24T01:54:44.825 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T01:54:44.825 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_rados_api_lock_pp 2024-04-24T01:54:44.841 INFO:tasks.workunit.client.0.smithi057.stdout:Running main() from gmock_main.cc 2024-04-24T01:54:44.841 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 16 tests from 2 test suites. 2024-04-24T01:54:44.841 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T01:54:44.841 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 8 tests from LibRadosLockPP 2024-04-24T01:54:44.841 INFO:tasks.workunit.client.0.smithi057.stdout:seed 31695 2024-04-24T01:54:46.818 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLockPP.LockExclusivePP 2024-04-24T01:54:47.128 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosLockPP.LockExclusivePP (311 ms) 2024-04-24T01:54:47.128 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLockPP.LockSharedPP 2024-04-24T01:54:47.182 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosLockPP.LockSharedPP (53 ms) 2024-04-24T01:54:47.182 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-04-24T01:54:48.214 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosLockPP.LockExclusiveDurPP (1032 ms) 2024-04-24T01:54:48.214 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLockPP.LockSharedDurPP 2024-04-24T01:54:49.247 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosLockPP.LockSharedDurPP (1034 ms) 2024-04-24T01:54:49.247 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLockPP.LockMayRenewPP 2024-04-24T01:54:49.284 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosLockPP.LockMayRenewPP (36 ms) 2024-04-24T01:54:49.284 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLockPP.UnlockPP 2024-04-24T01:54:49.320 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosLockPP.UnlockPP (36 ms) 2024-04-24T01:54:49.320 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLockPP.ListLockersPP 2024-04-24T01:54:49.368 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosLockPP.ListLockersPP (48 ms) 2024-04-24T01:54:49.368 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLockPP.BreakLockPP 2024-04-24T01:54:49.396 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosLockPP.BreakLockPP (28 ms) 2024-04-24T01:54:49.846 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 8 tests from LibRadosLockPP (2578 ms total) 2024-04-24T01:54:49.846 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:54:49.846 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 8 tests from LibRadosLockECPP 2024-04-24T01:54:49.846 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:373: Skipped 2024-04-24T01:54:49.846 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:49.846 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLockECPP.LockExclusivePP 2024-04-24T01:54:49.846 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:54:49.846 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:49.846 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:54:49.847 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:49.847 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusivePP (0 ms) 2024-04-24T01:54:49.847 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLockECPP.LockSharedPP 2024-04-24T01:54:49.847 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:54:49.847 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:49.847 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:54:49.847 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:49.847 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedPP (0 ms) 2024-04-24T01:54:49.847 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-04-24T01:54:49.847 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:54:49.847 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:49.847 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:54:49.847 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:49.847 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP (0 ms) 2024-04-24T01:54:49.848 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-04-24T01:54:49.848 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:54:49.848 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:49.848 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:54:49.848 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:49.848 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedDurPP (1 ms) 2024-04-24T01:54:49.848 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-04-24T01:54:49.848 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:54:49.848 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:49.848 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:54:49.848 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:49.848 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockECPP.LockMayRenewPP (0 ms) 2024-04-24T01:54:49.848 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLockECPP.UnlockPP 2024-04-24T01:54:49.848 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:54:49.848 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:49.849 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:54:49.849 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:49.849 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockECPP.UnlockPP (0 ms) 2024-04-24T01:54:49.849 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLockECPP.ListLockersPP 2024-04-24T01:54:49.849 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:54:49.849 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:49.849 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:54:49.849 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:49.849 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockECPP.ListLockersPP (0 ms) 2024-04-24T01:54:49.849 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosLockECPP.BreakLockPP 2024-04-24T01:54:49.849 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:54:49.849 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:49.849 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:54:49.849 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:49.850 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockECPP.BreakLockPP (0 ms) 2024-04-24T01:54:49.850 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:381: Skipped 2024-04-24T01:54:49.850 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:54:49.850 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 8 tests from LibRadosLockECPP (1 ms total) 2024-04-24T01:54:49.850 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:54:49.850 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T01:54:49.850 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 16 tests from 2 test suites ran. (5004 ms total) 2024-04-24T01:54:49.850 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 8 tests. 2024-04-24T01:54:49.850 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] 8 tests, listed below: 2024-04-24T01:54:49.850 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusivePP 2024-04-24T01:54:49.850 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedPP 2024-04-24T01:54:49.850 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockECPP.LockExclusiveDurPP 2024-04-24T01:54:49.850 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockECPP.LockSharedDurPP 2024-04-24T01:54:49.850 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockECPP.LockMayRenewPP 2024-04-24T01:54:49.851 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockECPP.UnlockPP 2024-04-24T01:54:49.851 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockECPP.ListLockersPP 2024-04-24T01:54:49.851 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosLockECPP.BreakLockPP 2024-04-24T01:54:49.851 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-24T01:54:49.851 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T01:54:49.851 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_rados_api_misc 2024-04-24T01:54:49.882 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:49.881+0000 7f778787c6c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:54:49.882 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:49.881+0000 7f778787c6c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:54:49.882 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:49.881+0000 7f778787c6c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:54:49.883 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 12 tests from 4 test suites. 2024-04-24T01:54:49.883 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T01:54:49.883 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 1 test from LibRadosMiscVersion 2024-04-24T01:54:49.883 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMiscVersion.Version 2024-04-24T01:54:49.883 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMiscVersion.Version (0 ms) 2024-04-24T01:54:49.883 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-04-24T01:54:49.883 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:54:49.883 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 2 tests from LibRadosMiscConnectFailure 2024-04-24T01:54:49.883 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-04-24T01:54:49.917 INFO:tasks.workunit.client.0.smithi057.stderr:unable to get monitor info from DNS SRV with service name: ceph-mon 2024-04-24T01:54:49.917 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:49.916+0000 7f778787c6c0 -1 failed for service _ceph-mon._tcp 2024-04-24T01:54:49.917 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:54:49.916+0000 7f778787c6c0 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-04-24T01:54:49.918 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMiscConnectFailure.ConnectFailure (35 ms) 2024-04-24T01:54:49.918 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-04-24T01:54:51.925 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMiscConnectFailure.ConnectTimeout (2007 ms) 2024-04-24T01:54:51.925 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 2 tests from LibRadosMiscConnectFailure (2042 ms total) 2024-04-24T01:54:51.925 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:54:51.925 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 1 test from LibRadosMiscPool 2024-04-24T01:54:51.925 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMiscPool.PoolCreationRace 2024-04-24T01:54:54.583 INFO:tasks.workunit.client.0.smithi057.stdout:started 0x7f7750005de0 2024-04-24T01:54:55.583 INFO:tasks.workunit.client.0.smithi057.stdout:started 0x7f7768005d20 2024-04-24T01:54:55.583 INFO:tasks.workunit.client.0.smithi057.stdout: started 2 aios 2024-04-24T01:54:55.584 INFO:tasks.workunit.client.0.smithi057.stdout:waiting 0x7f7750005de0 2024-04-24T01:54:55.584 INFO:tasks.workunit.client.0.smithi057.stdout:waiting 0x7f7768005d20 2024-04-24T01:54:55.588 INFO:tasks.workunit.client.0.smithi057.stdout:done. 2024-04-24T01:54:57.599 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMiscPool.PoolCreationRace (5675 ms) 2024-04-24T01:54:57.599 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 1 test from LibRadosMiscPool (5675 ms total) 2024-04-24T01:54:57.599 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:54:57.600 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 8 tests from LibRadosMisc 2024-04-24T01:54:59.594 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMisc.ClusterFSID 2024-04-24T01:54:59.595 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-04-24T01:54:59.595 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMisc.Exec 2024-04-24T01:54:59.938 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMisc.Exec (346 ms) 2024-04-24T01:54:59.938 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMisc.WriteSame 2024-04-24T01:55:00.051 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMisc.WriteSame (113 ms) 2024-04-24T01:55:00.051 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMisc.CmpExt 2024-04-24T01:55:00.074 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMisc.CmpExt (24 ms) 2024-04-24T01:55:00.074 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMisc.Applications 2024-04-24T01:55:04.609 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMisc.Applications (4534 ms) 2024-04-24T01:55:04.610 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMisc.MinCompatOSD 2024-04-24T01:55:04.610 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2024-04-24T01:55:04.610 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMisc.MinCompatClient 2024-04-24T01:55:04.610 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-04-24T01:55:04.610 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMisc.ShutdownRace 2024-04-24T01:55:32.653 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMisc.ShutdownRace (28044 ms) 2024-04-24T01:55:32.680 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 8 tests from LibRadosMisc (33061 ms total) 2024-04-24T01:55:32.680 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:55:32.680 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T01:55:32.680 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 12 tests from 4 test suites ran. (42797 ms total) 2024-04-24T01:55:32.680 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 12 tests. 2024-04-24T01:55:32.691 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-24T01:55:32.691 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T01:55:32.691 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_rados_api_misc_pp 2024-04-24T01:55:32.724 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:55:32.723+0000 7f95d75d5840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:55:32.724 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:55:32.723+0000 7f95d75d5840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:55:32.724 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:55:32.723+0000 7f95d75d5840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:55:32.724 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 31 tests from 7 test suites. 2024-04-24T01:55:32.724 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T01:55:32.725 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 1 test from LibRadosMiscVersion 2024-04-24T01:55:32.725 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMiscVersion.VersionPP 2024-04-24T01:55:32.725 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-04-24T01:55:32.725 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-04-24T01:55:32.725 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:55:32.725 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 22 tests from LibRadosMiscPP 2024-04-24T01:55:32.725 INFO:tasks.workunit.client.0.smithi057.stdout:seed 93363 2024-04-24T01:55:34.590 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-04-24T01:55:34.593 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMiscPP.WaitOSDMapPP (4 ms) 2024-04-24T01:55:34.593 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMiscPP.LongNamePP 2024-04-24T01:55:35.086 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMiscPP.LongNamePP (492 ms) 2024-04-24T01:55:35.086 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMiscPP.LongLocatorPP 2024-04-24T01:55:35.086 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/misc_cxx.cc:53: Skipped 2024-04-24T01:55:35.086 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:55:35.086 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosMiscPP.LongLocatorPP (0 ms) 2024-04-24T01:55:35.086 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMiscPP.LongNSpacePP 2024-04-24T01:55:35.135 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMiscPP.LongNSpacePP (50 ms) 2024-04-24T01:55:35.135 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-04-24T01:55:35.180 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMiscPP.LongAttrNamePP (44 ms) 2024-04-24T01:55:35.180 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMiscPP.ExecPP 2024-04-24T01:55:35.199 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMiscPP.ExecPP (20 ms) 2024-04-24T01:55:35.199 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMiscPP.BadFlagsPP 2024-04-24T01:55:35.213 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMiscPP.BadFlagsPP (13 ms) 2024-04-24T01:55:35.213 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMiscPP.Operate1PP 2024-04-24T01:55:35.239 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMiscPP.Operate1PP (26 ms) 2024-04-24T01:55:35.239 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMiscPP.Operate2PP 2024-04-24T01:55:35.253 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMiscPP.Operate2PP (15 ms) 2024-04-24T01:55:35.253 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMiscPP.BigObjectPP 2024-04-24T01:55:35.302 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMiscPP.BigObjectPP (48 ms) 2024-04-24T01:55:35.302 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMiscPP.AioOperatePP 2024-04-24T01:55:35.320 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMiscPP.AioOperatePP (19 ms) 2024-04-24T01:55:35.320 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMiscPP.AssertExistsPP 2024-04-24T01:55:35.344 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMiscPP.AssertExistsPP (22 ms) 2024-04-24T01:55:35.344 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMiscPP.AssertVersionPP 2024-04-24T01:55:35.387 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMiscPP.AssertVersionPP (45 ms) 2024-04-24T01:55:35.387 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMiscPP.BigAttrPP 2024-04-24T01:55:35.397 INFO:tasks.workunit.client.0.smithi057.stdout:osd_max_attr_size = 0 2024-04-24T01:55:35.397 INFO:tasks.workunit.client.0.smithi057.stdout:osd_max_attr_size == 0; skipping test 2024-04-24T01:55:51.498 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMiscPP.BigAttrPP (16109 ms) 2024-04-24T01:55:51.498 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMiscPP.CopyPP 2024-04-24T01:55:51.498 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/misc_cxx.cc:387: Skipped 2024-04-24T01:55:51.498 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:55:51.499 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosMiscPP.CopyPP (1 ms) 2024-04-24T01:55:51.499 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMiscPP.CopyScrubPP 2024-04-24T01:55:51.499 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/misc_cxx.cc:550: Skipped 2024-04-24T01:55:51.499 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:55:51.499 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosMiscPP.CopyScrubPP (0 ms) 2024-04-24T01:55:51.499 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMiscPP.WriteSamePP 2024-04-24T01:55:51.533 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMiscPP.WriteSamePP (36 ms) 2024-04-24T01:55:51.533 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMiscPP.CmpExtPP 2024-04-24T01:55:51.553 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMiscPP.CmpExtPP (19 ms) 2024-04-24T01:55:51.554 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMiscPP.Applications 2024-04-24T01:55:55.731 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMiscPP.Applications (4178 ms) 2024-04-24T01:55:55.731 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMiscPP.MinCompatOSD 2024-04-24T01:55:55.731 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2024-04-24T01:55:55.731 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMiscPP.MinCompatClient 2024-04-24T01:55:55.731 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2024-04-24T01:55:55.731 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMiscPP.Conf 2024-04-24T01:55:55.731 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosMiscPP.Conf (0 ms) 2024-04-24T01:55:56.739 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 22 tests from LibRadosMiscPP (21141 ms total) 2024-04-24T01:55:56.739 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:55:56.739 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 1 test from LibRadosTwoPoolsECPP 2024-04-24T01:55:56.739 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/misc_cxx.cc:477: Skipped 2024-04-24T01:55:56.739 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:55:56.739 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-04-24T01:55:56.740 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/misc_cxx.cc:499: Skipped 2024-04-24T01:55:56.740 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:55:56.740 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/misc_cxx.cc:505: Skipped 2024-04-24T01:55:56.740 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:55:56.740 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom (0 ms) 2024-04-24T01:55:56.740 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/misc_cxx.cc:492: Skipped 2024-04-24T01:55:56.740 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:55:56.740 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 1 test from LibRadosTwoPoolsECPP (0 ms total) 2024-04-24T01:55:56.740 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:55:56.740 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-04-24T01:55:58.594 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosChecksum/0.Subset 2024-04-24T01:55:58.963 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosChecksum/0.Subset (368 ms) 2024-04-24T01:55:58.963 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosChecksum/0.Chunked 2024-04-24T01:55:58.977 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosChecksum/0.Chunked (15 ms) 2024-04-24T01:55:59.600 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 2 tests from LibRadosChecksum/0 (383 ms total) 2024-04-24T01:55:59.600 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:55:59.600 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-04-24T01:56:01.616 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosChecksum/1.Subset 2024-04-24T01:56:01.989 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosChecksum/1.Subset (374 ms) 2024-04-24T01:56:01.990 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosChecksum/1.Chunked 2024-04-24T01:56:02.025 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosChecksum/1.Chunked (35 ms) 2024-04-24T01:56:02.615 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 2 tests from LibRadosChecksum/1 (409 ms total) 2024-04-24T01:56:02.615 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:56:02.615 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-04-24T01:56:04.626 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosChecksum/2.Subset 2024-04-24T01:56:04.939 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosChecksum/2.Subset (313 ms) 2024-04-24T01:56:04.939 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosChecksum/2.Chunked 2024-04-24T01:56:05.025 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosChecksum/2.Chunked (87 ms) 2024-04-24T01:56:05.650 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 2 tests from LibRadosChecksum/2 (400 ms total) 2024-04-24T01:56:05.650 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:56:05.650 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 1 test from LibRadosMiscECPP 2024-04-24T01:56:05.651 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:373: Skipped 2024-04-24T01:56:05.651 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:05.651 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-04-24T01:56:05.651 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:56:05.651 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:05.651 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:56:05.651 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:05.651 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosMiscECPP.CompareExtentRange (0 ms) 2024-04-24T01:56:05.651 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:381: Skipped 2024-04-24T01:56:05.651 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:05.651 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 1 test from LibRadosMiscECPP (0 ms total) 2024-04-24T01:56:05.651 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:56:05.651 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T01:56:05.651 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 31 tests from 7 test suites ran. (32925 ms total) 2024-04-24T01:56:05.652 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 26 tests. 2024-04-24T01:56:05.652 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] 5 tests, listed below: 2024-04-24T01:56:05.652 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosMiscPP.LongLocatorPP 2024-04-24T01:56:05.652 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosMiscPP.CopyPP 2024-04-24T01:56:05.652 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosMiscPP.CopyScrubPP 2024-04-24T01:56:05.652 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CopyFrom 2024-04-24T01:56:05.652 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosMiscECPP.CompareExtentRange 2024-04-24T01:56:05.653 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-24T01:56:05.653 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T01:56:05.653 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_rados_api_tier_pp 2024-04-24T01:56:05.690 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:56:05.688+0000 7f0e80f5c9c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:56:05.690 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:56:05.688+0000 7f0e80f5c9c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:56:05.690 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:56:05.688+0000 7f0e80f5c9c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:56:05.690 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 77 tests from 4 test suites. 2024-04-24T01:56:05.690 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T01:56:05.690 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 3 tests from LibRadosTierPP 2024-04-24T01:56:05.691 INFO:tasks.workunit.client.0.smithi057.stdout:seed 93435 2024-04-24T01:56:07.654 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTierPP.Dirty 2024-04-24T01:56:07.654 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:287: Skipped 2024-04-24T01:56:07.654 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:07.654 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTierPP.Dirty (0 ms) 2024-04-24T01:56:07.654 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTierPP.FlushWriteRaces 2024-04-24T01:56:07.654 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:2182: Skipped 2024-04-24T01:56:07.654 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:07.655 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTierPP.FlushWriteRaces (0 ms) 2024-04-24T01:56:07.655 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTierPP.HitSetNone 2024-04-24T01:56:07.655 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:2561: Skipped 2024-04-24T01:56:07.655 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:07.655 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTierPP.HitSetNone (0 ms) 2024-04-24T01:56:08.597 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 3 tests from LibRadosTierPP (0 ms total) 2024-04-24T01:56:08.598 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:56:08.598 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 48 tests from LibRadosTwoPoolsPP 2024-04-24T01:56:10.611 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.Overlay 2024-04-24T01:56:10.611 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.611 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.611 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.611 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.611 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Overlay (0 ms) 2024-04-24T01:56:10.611 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.Promote 2024-04-24T01:56:10.611 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.611 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.611 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.612 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.612 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Promote (0 ms) 2024-04-24T01:56:10.612 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-04-24T01:56:10.612 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.612 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.612 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.612 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.612 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap (0 ms) 2024-04-24T01:56:10.612 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-04-24T01:56:10.612 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.612 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.612 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.613 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.613 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub (0 ms) 2024-04-24T01:56:10.613 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-04-24T01:56:10.613 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.613 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.613 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.613 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.613 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (0 ms) 2024-04-24T01:56:10.613 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-04-24T01:56:10.613 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.613 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.613 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.613 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.613 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Whiteout (0 ms) 2024-04-24T01:56:10.614 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-04-24T01:56:10.614 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.614 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.614 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.614 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.614 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (0 ms) 2024-04-24T01:56:10.614 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.Evict 2024-04-24T01:56:10.614 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.614 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.614 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.614 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.614 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Evict (0 ms) 2024-04-24T01:56:10.614 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-04-24T01:56:10.615 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.615 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.615 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.615 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.615 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap (0 ms) 2024-04-24T01:56:10.615 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-04-24T01:56:10.615 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.615 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.615 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.615 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.615 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 (0 ms) 2024-04-24T01:56:10.615 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-04-24T01:56:10.615 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.615 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.615 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.616 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.616 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ListSnap (0 ms) 2024-04-24T01:56:10.616 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-04-24T01:56:10.616 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.616 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.616 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.616 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.616 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (0 ms) 2024-04-24T01:56:10.616 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-04-24T01:56:10.616 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.616 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.616 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.616 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.616 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlush (0 ms) 2024-04-24T01:56:10.617 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.Flush 2024-04-24T01:56:10.617 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.617 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.617 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.617 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.617 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Flush (0 ms) 2024-04-24T01:56:10.617 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-04-24T01:56:10.617 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.617 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.617 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.617 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.617 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap (0 ms) 2024-04-24T01:56:10.617 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-04-24T01:56:10.617 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.618 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.618 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.618 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.618 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces (0 ms) 2024-04-24T01:56:10.618 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-04-24T01:56:10.618 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.618 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.618 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.618 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.618 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace (0 ms) 2024-04-24T01:56:10.618 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetRead 2024-04-24T01:56:10.618 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.618 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.619 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.619 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.619 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead (0 ms) 2024-04-24T01:56:10.619 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-04-24T01:56:10.619 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.619 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.619 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.619 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.619 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite (0 ms) 2024-04-24T01:56:10.619 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2024-04-24T01:56:10.619 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.619 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.619 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.619 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.619 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim (0 ms) 2024-04-24T01:56:10.620 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-04-24T01:56:10.620 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.620 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.620 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.620 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.620 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead (0 ms) 2024-04-24T01:56:10.620 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.ProxyRead 2024-04-24T01:56:10.620 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.620 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.620 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.620 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.620 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead (0 ms) 2024-04-24T01:56:10.620 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.CachePin 2024-04-24T01:56:10.620 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.620 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.621 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.621 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.621 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.CachePin (0 ms) 2024-04-24T01:56:10.621 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2024-04-24T01:56:10.621 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.621 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.621 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.621 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.621 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead (0 ms) 2024-04-24T01:56:10.621 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-04-24T01:56:10.621 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.621 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.621 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.621 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.622 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead (0 ms) 2024-04-24T01:56:10.622 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2024-04-24T01:56:10.622 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.622 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.622 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.622 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.622 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead (0 ms) 2024-04-24T01:56:10.622 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2024-04-24T01:56:10.622 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.622 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.622 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.622 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.622 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset (0 ms) 2024-04-24T01:56:10.622 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-04-24T01:56:10.623 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.623 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.623 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.623 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.623 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead (0 ms) 2024-04-24T01:56:10.623 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-04-24T01:56:10.623 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.623 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.623 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.623 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.623 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount (0 ms) 2024-04-24T01:56:10.623 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-04-24T01:56:10.623 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.623 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.624 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.624 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.624 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (0 ms) 2024-04-24T01:56:10.624 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-04-24T01:56:10.624 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.624 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.624 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.624 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.624 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (0 ms) 2024-04-24T01:56:10.624 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-04-24T01:56:10.624 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.624 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.624 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.624 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.624 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (0 ms) 2024-04-24T01:56:10.625 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-04-24T01:56:10.625 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.625 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.625 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.625 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.625 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (0 ms) 2024-04-24T01:56:10.625 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-04-24T01:56:10.625 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.625 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.625 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.625 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.625 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount (0 ms) 2024-04-24T01:56:10.625 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2024-04-24T01:56:10.625 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.625 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.626 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.626 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.626 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict (0 ms) 2024-04-24T01:56:10.626 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-04-24T01:56:10.626 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.626 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.626 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.626 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.626 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote (0 ms) 2024-04-24T01:56:10.626 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-04-24T01:56:10.626 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.626 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.626 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.627 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.627 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (0 ms) 2024-04-24T01:56:10.627 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2024-04-24T01:56:10.627 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.627 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.627 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.627 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.627 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead (0 ms) 2024-04-24T01:56:10.627 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-04-24T01:56:10.627 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.627 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.627 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.627 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.627 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap (0 ms) 2024-04-24T01:56:10.628 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-04-24T01:56:10.628 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.628 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.628 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.628 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.628 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount (0 ms) 2024-04-24T01:56:10.628 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-04-24T01:56:10.628 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.628 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.628 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.628 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.628 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush (0 ms) 2024-04-24T01:56:10.628 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-04-24T01:56:10.628 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.629 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.629 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.629 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.629 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (1 ms) 2024-04-24T01:56:10.629 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2024-04-24T01:56:10.629 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.629 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.629 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.629 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.629 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback (0 ms) 2024-04-24T01:56:10.629 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-04-24T01:56:10.630 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.630 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.630 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.630 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.630 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (0 ms) 2024-04-24T01:56:10.630 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-04-24T01:56:10.630 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.630 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.630 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.630 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.630 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback (0 ms) 2024-04-24T01:56:10.630 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-04-24T01:56:10.630 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.631 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.631 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.631 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.631 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError (0 ms) 2024-04-24T01:56:10.631 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-04-24T01:56:10.631 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.631 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.631 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.631 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.631 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn (0 ms) 2024-04-24T01:56:10.631 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-04-24T01:56:10.631 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:223: Skipped 2024-04-24T01:56:10.631 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.631 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:233: Skipped 2024-04-24T01:56:10.631 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:10.632 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (0 ms) 2024-04-24T01:56:11.607 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 48 tests from LibRadosTwoPoolsPP (1 ms total) 2024-04-24T01:56:11.607 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:56:11.607 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 4 tests from LibRadosTierECPP 2024-04-24T01:56:11.607 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:373: Skipped 2024-04-24T01:56:11.607 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.607 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTierECPP.Dirty 2024-04-24T01:56:11.607 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:56:11.607 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.607 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:56:11.607 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.607 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTierECPP.Dirty (0 ms) 2024-04-24T01:56:11.607 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTierECPP.FlushWriteRaces 2024-04-24T01:56:11.608 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:56:11.608 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.608 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:56:11.608 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.608 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTierECPP.FlushWriteRaces (0 ms) 2024-04-24T01:56:11.608 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTierECPP.CallForcesPromote 2024-04-24T01:56:11.608 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:56:11.608 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.608 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:56:11.608 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.608 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTierECPP.CallForcesPromote (0 ms) 2024-04-24T01:56:11.608 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTierECPP.HitSetNone 2024-04-24T01:56:11.608 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:56:11.608 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.609 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:56:11.609 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.609 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTierECPP.HitSetNone (0 ms) 2024-04-24T01:56:11.609 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:381: Skipped 2024-04-24T01:56:11.609 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.609 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 4 tests from LibRadosTierECPP (0 ms total) 2024-04-24T01:56:11.609 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:56:11.609 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 22 tests from LibRadosTwoPoolsECPP 2024-04-24T01:56:11.609 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6267: Skipped 2024-04-24T01:56:11.609 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.609 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsECPP.Overlay 2024-04-24T01:56:11.609 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-24T01:56:11.609 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.609 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-24T01:56:11.610 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.610 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Overlay (0 ms) 2024-04-24T01:56:11.610 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsECPP.Promote 2024-04-24T01:56:11.610 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-24T01:56:11.610 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.610 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-24T01:56:11.610 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.610 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Promote (0 ms) 2024-04-24T01:56:11.610 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2024-04-24T01:56:11.610 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-24T01:56:11.610 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.610 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-24T01:56:11.610 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.610 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap (0 ms) 2024-04-24T01:56:11.611 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-04-24T01:56:11.611 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-24T01:56:11.611 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.611 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-24T01:56:11.611 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.611 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (0 ms) 2024-04-24T01:56:11.611 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsECPP.Whiteout 2024-04-24T01:56:11.611 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-24T01:56:11.611 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.611 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-24T01:56:11.611 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.611 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout (0 ms) 2024-04-24T01:56:11.611 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsECPP.Evict 2024-04-24T01:56:11.611 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-24T01:56:11.611 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.612 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-24T01:56:11.612 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.612 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Evict (0 ms) 2024-04-24T01:56:11.612 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2024-04-24T01:56:11.612 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-24T01:56:11.612 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.612 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-24T01:56:11.612 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.612 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap (0 ms) 2024-04-24T01:56:11.612 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsECPP.TryFlush 2024-04-24T01:56:11.612 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-24T01:56:11.612 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.612 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-24T01:56:11.613 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.613 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush (0 ms) 2024-04-24T01:56:11.613 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2024-04-24T01:56:11.613 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-24T01:56:11.613 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.613 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-24T01:56:11.613 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.613 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush (1 ms) 2024-04-24T01:56:11.613 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsECPP.Flush 2024-04-24T01:56:11.613 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-24T01:56:11.613 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.613 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-24T01:56:11.613 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.613 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Flush (0 ms) 2024-04-24T01:56:11.614 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2024-04-24T01:56:11.614 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-24T01:56:11.614 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.614 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-24T01:56:11.614 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.614 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap (0 ms) 2024-04-24T01:56:11.614 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-04-24T01:56:11.614 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-24T01:56:11.614 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.614 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-24T01:56:11.614 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.614 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (0 ms) 2024-04-24T01:56:11.614 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-04-24T01:56:11.615 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-24T01:56:11.615 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.615 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-24T01:56:11.615 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.615 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace (0 ms) 2024-04-24T01:56:11.615 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2024-04-24T01:56:11.615 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-24T01:56:11.615 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.615 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-24T01:56:11.615 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.615 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead (0 ms) 2024-04-24T01:56:11.615 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2024-04-24T01:56:11.615 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-24T01:56:11.615 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.616 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-24T01:56:11.616 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.616 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim (0 ms) 2024-04-24T01:56:11.616 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-04-24T01:56:11.616 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-24T01:56:11.616 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.616 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-24T01:56:11.616 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.616 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (0 ms) 2024-04-24T01:56:11.616 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2024-04-24T01:56:11.616 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-24T01:56:11.616 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.616 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-24T01:56:11.616 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.617 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead (0 ms) 2024-04-24T01:56:11.617 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsECPP.CachePin 2024-04-24T01:56:11.617 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-24T01:56:11.617 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.617 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-24T01:56:11.617 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.617 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CachePin (0 ms) 2024-04-24T01:56:11.617 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-04-24T01:56:11.617 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-24T01:56:11.617 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.617 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-24T01:56:11.617 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.617 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead (0 ms) 2024-04-24T01:56:11.617 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2024-04-24T01:56:11.618 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-24T01:56:11.618 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.618 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-24T01:56:11.618 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.618 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead (0 ms) 2024-04-24T01:56:11.618 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-04-24T01:56:11.618 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-24T01:56:11.618 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.618 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-24T01:56:11.618 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.618 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead (0 ms) 2024-04-24T01:56:11.618 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-04-24T01:56:11.618 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6278: Skipped 2024-04-24T01:56:11.618 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.619 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6288: Skipped 2024-04-24T01:56:11.619 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.619 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier (0 ms) 2024-04-24T01:56:11.619 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/tier_cxx.cc:6272: Skipped 2024-04-24T01:56:11.619 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:11.619 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 22 tests from LibRadosTwoPoolsECPP (1 ms total) 2024-04-24T01:56:11.619 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:56:11.619 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T01:56:11.619 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 77 tests from 4 test suites ran. (5913 ms total) 2024-04-24T01:56:11.619 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 0 tests. 2024-04-24T01:56:11.619 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] 77 tests, listed below: 2024-04-24T01:56:11.619 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTierPP.Dirty 2024-04-24T01:56:11.619 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTierPP.FlushWriteRaces 2024-04-24T01:56:11.619 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTierPP.HitSetNone 2024-04-24T01:56:11.620 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Overlay 2024-04-24T01:56:11.620 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Promote 2024-04-24T01:56:11.620 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnap 2024-04-24T01:56:11.620 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-04-24T01:56:11.620 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-04-24T01:56:11.620 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Whiteout 2024-04-24T01:56:11.620 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-04-24T01:56:11.620 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Evict 2024-04-24T01:56:11.620 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap 2024-04-24T01:56:11.620 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnap2 2024-04-24T01:56:11.620 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ListSnap 2024-04-24T01:56:11.620 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-04-24T01:56:11.620 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlush 2024-04-24T01:56:11.620 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.Flush 2024-04-24T01:56:11.620 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushSnap 2024-04-24T01:56:11.621 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-04-24T01:56:11.621 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-04-24T01:56:11.621 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetRead 2024-04-24T01:56:11.621 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetWrite 2024-04-24T01:56:11.621 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HitSetTrim 2024-04-24T01:56:11.621 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-04-24T01:56:11.621 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ProxyRead 2024-04-24T01:56:11.621 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.CachePin 2024-04-24T01:56:11.621 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.SetRedirectRead 2024-04-24T01:56:11.621 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-04-24T01:56:11.621 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRefRead 2024-04-24T01:56:11.621 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestUnset 2024-04-24T01:56:11.621 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-04-24T01:56:11.621 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-04-24T01:56:11.621 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-04-24T01:56:11.622 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-04-24T01:56:11.622 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-04-24T01:56:11.622 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-04-24T01:56:11.622 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-04-24T01:56:11.622 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvict 2024-04-24T01:56:11.622 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-04-24T01:56:11.622 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-04-24T01:56:11.622 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.DedupFlushRead 2024-04-24T01:56:11.622 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-04-24T01:56:11.622 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-04-24T01:56:11.622 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-04-24T01:56:11.622 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-04-24T01:56:11.622 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollback 2024-04-24T01:56:11.622 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-04-24T01:56:11.623 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-04-24T01:56:11.623 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-04-24T01:56:11.623 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-04-24T01:56:11.623 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-04-24T01:56:11.623 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTierECPP.Dirty 2024-04-24T01:56:11.623 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTierECPP.FlushWriteRaces 2024-04-24T01:56:11.623 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTierECPP.CallForcesPromote 2024-04-24T01:56:11.623 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTierECPP.HitSetNone 2024-04-24T01:56:11.623 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Overlay 2024-04-24T01:56:11.623 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Promote 2024-04-24T01:56:11.623 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnap 2024-04-24T01:56:11.623 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-04-24T01:56:11.623 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Whiteout 2024-04-24T01:56:11.623 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Evict 2024-04-24T01:56:11.623 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.EvictSnap 2024-04-24T01:56:11.624 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlush 2024-04-24T01:56:11.624 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FailedFlush 2024-04-24T01:56:11.624 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.Flush 2024-04-24T01:56:11.624 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushSnap 2024-04-24T01:56:11.624 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-04-24T01:56:11.624 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-04-24T01:56:11.624 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetRead 2024-04-24T01:56:11.624 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.HitSetTrim 2024-04-24T01:56:11.624 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-04-24T01:56:11.624 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ProxyRead 2024-04-24T01:56:11.624 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.CachePin 2024-04-24T01:56:11.624 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-04-24T01:56:11.624 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.SetChunkRead 2024-04-24T01:56:11.624 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-04-24T01:56:11.624 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-04-24T01:56:11.625 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-24T01:56:11.625 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T01:56:11.625 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_rados_api_pool 2024-04-24T01:56:11.629 INFO:tasks.workunit.client.0.smithi057.stdout:Running main() from gmock_main.cc 2024-04-24T01:56:11.629 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 9 tests from 1 test suite. 2024-04-24T01:56:11.629 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T01:56:11.629 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 9 tests from LibRadosPools 2024-04-24T01:56:11.629 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosPools.PoolList 2024-04-24T01:56:14.627 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosPools.PoolList (2998 ms) 2024-04-24T01:56:14.627 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosPools.PoolLookup 2024-04-24T01:56:17.654 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosPools.PoolLookup (3028 ms) 2024-04-24T01:56:17.655 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosPools.PoolLookup2 2024-04-24T01:56:20.604 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosPools.PoolLookup2 (2949 ms) 2024-04-24T01:56:20.604 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-04-24T01:56:23.622 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosPools.PoolLookupOtherInstance (3018 ms) 2024-04-24T01:56:23.622 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-04-24T01:56:26.650 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3028 ms) 2024-04-24T01:56:26.650 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosPools.PoolDelete 2024-04-24T01:56:31.617 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosPools.PoolDelete (4967 ms) 2024-04-24T01:56:31.618 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosPools.PoolCreateDelete 2024-04-24T01:56:36.651 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosPools.PoolCreateDelete (5035 ms) 2024-04-24T01:56:36.652 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-04-24T01:56:41.621 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosPools.PoolCreateWithCrushRule (4969 ms) 2024-04-24T01:56:41.621 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosPools.PoolGetBaseTier 2024-04-24T01:56:41.621 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/pool.cc:139: Skipped 2024-04-24T01:56:41.621 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:56:41.621 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosPools.PoolGetBaseTier (0 ms) 2024-04-24T01:56:41.621 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 9 tests from LibRadosPools (29992 ms total) 2024-04-24T01:56:41.621 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:56:41.621 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T01:56:41.622 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 9 tests from 1 test suite ran. (29992 ms total) 2024-04-24T01:56:41.622 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 8 tests. 2024-04-24T01:56:41.622 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] 1 test, listed below: 2024-04-24T01:56:41.622 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosPools.PoolGetBaseTier 2024-04-24T01:56:41.623 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-24T01:56:41.623 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T01:56:41.623 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_rados_api_snapshots 2024-04-24T01:56:41.650 INFO:tasks.workunit.client.0.smithi057.stdout:Running main() from gmock_main.cc 2024-04-24T01:56:41.650 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 13 tests from 4 test suites. 2024-04-24T01:56:41.650 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T01:56:41.650 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 4 tests from LibRadosSnapshots 2024-04-24T01:56:43.640 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshots.SnapList 2024-04-24T01:56:45.648 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosSnapshots.SnapList (2008 ms) 2024-04-24T01:56:45.649 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshots.SnapRemove 2024-04-24T01:56:47.657 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosSnapshots.SnapRemove (2009 ms) 2024-04-24T01:56:47.658 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshots.Rollback 2024-04-24T01:56:49.665 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosSnapshots.Rollback (2007 ms) 2024-04-24T01:56:49.665 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshots.SnapGetName 2024-04-24T01:56:51.678 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosSnapshots.SnapGetName (2014 ms) 2024-04-24T01:56:52.680 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 4 tests from LibRadosSnapshots (8038 ms total) 2024-04-24T01:56:52.680 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:56:52.680 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManaged 2024-04-24T01:56:54.707 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-04-24T01:56:58.756 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosSnapshotsSelfManaged.Snap (4050 ms) 2024-04-24T01:56:58.757 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-04-24T01:57:02.965 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosSnapshotsSelfManaged.Rollback (4208 ms) 2024-04-24T01:57:02.965 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2024-04-24T01:57:08.033 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (5068 ms) 2024-04-24T01:57:08.608 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManaged (13326 ms total) 2024-04-24T01:57:08.608 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:57:08.608 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 4 tests from LibRadosSnapshotsEC 2024-04-24T01:57:08.608 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:168: Skipped 2024-04-24T01:57:08.608 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:08.608 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshotsEC.SnapList 2024-04-24T01:57:08.608 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:182: Skipped 2024-04-24T01:57:08.608 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:08.609 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:196: Skipped 2024-04-24T01:57:08.609 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:08.609 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapList (1 ms) 2024-04-24T01:57:08.609 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-04-24T01:57:08.609 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:182: Skipped 2024-04-24T01:57:08.609 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:08.609 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:196: Skipped 2024-04-24T01:57:08.609 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:08.609 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapRemove (0 ms) 2024-04-24T01:57:08.609 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshotsEC.Rollback 2024-04-24T01:57:08.609 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:182: Skipped 2024-04-24T01:57:08.609 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:08.609 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:196: Skipped 2024-04-24T01:57:08.609 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:08.610 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsEC.Rollback (0 ms) 2024-04-24T01:57:08.610 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-04-24T01:57:08.610 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:182: Skipped 2024-04-24T01:57:08.610 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:08.610 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:196: Skipped 2024-04-24T01:57:08.610 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:08.610 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapGetName (0 ms) 2024-04-24T01:57:08.610 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:176: Skipped 2024-04-24T01:57:08.610 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:08.610 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 4 tests from LibRadosSnapshotsEC (1 ms total) 2024-04-24T01:57:08.610 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:57:08.610 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-04-24T01:57:08.610 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:168: Skipped 2024-04-24T01:57:08.610 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:08.611 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-04-24T01:57:08.611 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:182: Skipped 2024-04-24T01:57:08.611 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:08.611 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:196: Skipped 2024-04-24T01:57:08.611 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:08.611 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap (0 ms) 2024-04-24T01:57:08.611 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-04-24T01:57:08.611 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:182: Skipped 2024-04-24T01:57:08.611 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:08.611 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:196: Skipped 2024-04-24T01:57:08.611 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:08.611 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback (0 ms) 2024-04-24T01:57:08.611 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:176: Skipped 2024-04-24T01:57:08.611 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:08.611 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 2 tests from LibRadosSnapshotsSelfManagedEC (0 ms total) 2024-04-24T01:57:08.612 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:57:08.612 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T01:57:08.612 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 13 tests from 4 test suites ran. (26957 ms total) 2024-04-24T01:57:08.612 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 7 tests. 2024-04-24T01:57:08.612 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] 6 tests, listed below: 2024-04-24T01:57:08.612 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapList 2024-04-24T01:57:08.612 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapRemove 2024-04-24T01:57:08.612 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsEC.Rollback 2024-04-24T01:57:08.612 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsEC.SnapGetName 2024-04-24T01:57:08.612 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Snap 2024-04-24T01:57:08.612 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-04-24T01:57:08.613 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-24T01:57:08.613 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T01:57:08.613 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_rados_api_snapshots_pp 2024-04-24T01:57:08.627 INFO:tasks.workunit.client.0.smithi057.stdout:Running main() from gmock_main.cc 2024-04-24T01:57:08.627 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 21 tests from 5 test suites. 2024-04-24T01:57:08.627 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T01:57:08.628 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 5 tests from LibRadosSnapshotsPP 2024-04-24T01:57:08.628 INFO:tasks.workunit.client.0.smithi057.stdout:seed 93691 2024-04-24T01:57:10.612 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-04-24T01:57:12.624 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosSnapshotsPP.SnapListPP (2011 ms) 2024-04-24T01:57:12.624 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-04-24T01:57:14.635 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosSnapshotsPP.SnapRemovePP (2011 ms) 2024-04-24T01:57:14.635 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-04-24T01:57:16.657 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosSnapshotsPP.RollbackPP (2023 ms) 2024-04-24T01:57:16.658 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-04-24T01:57:18.609 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosSnapshotsPP.SnapGetNamePP (1952 ms) 2024-04-24T01:57:18.610 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-04-24T01:57:22.686 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (4077 ms) 2024-04-24T01:57:23.691 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 5 tests from LibRadosSnapshotsPP (12074 ms total) 2024-04-24T01:57:23.691 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:57:23.692 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2024-04-24T01:57:25.711 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-04-24T01:57:29.765 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (4054 ms) 2024-04-24T01:57:29.766 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-04-24T01:57:29.766 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/snapshots_cxx.cc:156: Skipped 2024-04-24T01:57:29.766 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:29.766 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.RollbackPP (0 ms) 2024-04-24T01:57:29.766 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-04-24T01:57:29.766 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/snapshots_cxx.cc:242: Skipped 2024-04-24T01:57:29.766 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:29.766 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (0 ms) 2024-04-24T01:57:29.766 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-04-24T01:57:33.750 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (3985 ms) 2024-04-24T01:57:33.750 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-04-24T01:57:35.917 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2167 ms) 2024-04-24T01:57:35.917 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-04-24T01:57:35.917 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/snapshots_cxx.cc:463: Skipped 2024-04-24T01:57:35.917 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:57:35.917 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2024-04-24T01:57:35.917 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-04-24T01:57:37.773 INFO:tasks.workunit.client.0.smithi057.stdout:deleting snap 9 in pool LibRadosSnapshotsSelfManagedPP_smithi057-93691-7 2024-04-24T01:57:38.611 INFO:tasks.workunit.client.0.smithi057.stdout:waiting for snaps to purge 2024-04-24T01:57:53.629 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17713 ms) 2024-04-24T01:57:54.099 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 7 tests from LibRadosSnapshotsSelfManagedPP (27919 ms total) 2024-04-24T01:57:54.099 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:57:54.099 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-04-24T01:57:54.099 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-04-24T01:57:54.105 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (6 ms) 2024-04-24T01:57:54.105 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-04-24T01:57:58.650 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (4545 ms) 2024-04-24T01:57:58.650 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (4551 ms total) 2024-04-24T01:57:58.650 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:57:58.650 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 4 tests from LibRadosSnapshotsECPP 2024-04-24T01:57:58.650 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:373: Skipped 2024-04-24T01:57:58.651 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:58.651 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-04-24T01:57:58.651 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:57:58.651 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:58.651 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:57:58.651 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:58.651 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP (0 ms) 2024-04-24T01:57:58.651 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-04-24T01:57:58.651 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:57:58.651 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:58.651 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:57:58.651 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:58.652 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP (0 ms) 2024-04-24T01:57:58.652 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-04-24T01:57:58.652 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:57:58.652 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:58.652 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:57:58.652 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:58.652 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP (0 ms) 2024-04-24T01:57:58.652 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-04-24T01:57:58.652 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:57:58.652 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:58.652 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:57:58.652 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:58.652 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP (0 ms) 2024-04-24T01:57:58.653 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:381: Skipped 2024-04-24T01:57:58.653 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:58.653 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 4 tests from LibRadosSnapshotsECPP (0 ms total) 2024-04-24T01:57:58.653 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:57:58.653 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-04-24T01:57:58.653 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:373: Skipped 2024-04-24T01:57:58.653 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:58.653 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-04-24T01:57:58.653 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:57:58.653 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:58.653 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:57:58.653 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:58.653 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP (0 ms) 2024-04-24T01:57:58.653 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-04-24T01:57:58.654 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:57:58.654 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:58.654 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:57:58.654 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:58.654 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (0 ms) 2024-04-24T01:57:58.654 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-04-24T01:57:58.654 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:57:58.654 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:58.654 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:57:58.654 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:58.654 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (0 ms) 2024-04-24T01:57:58.654 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:381: Skipped 2024-04-24T01:57:58.654 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:57:58.654 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (0 ms total) 2024-04-24T01:57:58.655 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:57:58.655 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T01:57:58.655 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 21 tests from 5 test suites ran. (50023 ms total) 2024-04-24T01:57:58.655 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 11 tests. 2024-04-24T01:57:58.655 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] 10 tests, listed below: 2024-04-24T01:57:58.655 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-04-24T01:57:58.655 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-04-24T01:57:58.655 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-04-24T01:57:58.655 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapListPP 2024-04-24T01:57:58.655 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapRemovePP 2024-04-24T01:57:58.655 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.RollbackPP 2024-04-24T01:57:58.655 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-04-24T01:57:58.655 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-04-24T01:57:58.655 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-04-24T01:57:58.656 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-04-24T01:57:58.656 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-24T01:57:58.656 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T01:57:58.656 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_rados_api_stat 2024-04-24T01:57:58.673 INFO:tasks.workunit.client.0.smithi057.stdout:Running main() from gmock_main.cc 2024-04-24T01:57:58.673 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 9 tests from 2 test suites. 2024-04-24T01:57:58.673 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T01:57:58.674 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 5 tests from LibRadosStat 2024-04-24T01:58:00.642 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosStat.Stat 2024-04-24T01:58:01.001 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosStat.Stat (359 ms) 2024-04-24T01:58:01.002 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosStat.Stat2 2024-04-24T01:58:01.026 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosStat.Stat2 (24 ms) 2024-04-24T01:58:01.026 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosStat.StatNS 2024-04-24T01:58:01.081 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosStat.StatNS (55 ms) 2024-04-24T01:58:01.081 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosStat.ClusterStat 2024-04-24T01:58:01.082 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosStat.ClusterStat (0 ms) 2024-04-24T01:58:01.082 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosStat.PoolStat 2024-04-24T01:58:01.091 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosStat.PoolStat (10 ms) 2024-04-24T01:58:01.658 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 5 tests from LibRadosStat (448 ms total) 2024-04-24T01:58:01.658 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:58:01.659 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 4 tests from LibRadosStatEC 2024-04-24T01:58:01.659 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:168: Skipped 2024-04-24T01:58:01.659 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:58:01.659 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosStatEC.Stat 2024-04-24T01:58:01.659 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:182: Skipped 2024-04-24T01:58:01.659 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:58:01.659 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:196: Skipped 2024-04-24T01:58:01.659 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:58:01.659 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosStatEC.Stat (0 ms) 2024-04-24T01:58:01.659 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosStatEC.StatNS 2024-04-24T01:58:01.659 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:182: Skipped 2024-04-24T01:58:01.659 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:58:01.659 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:196: Skipped 2024-04-24T01:58:01.660 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:58:01.660 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosStatEC.StatNS (0 ms) 2024-04-24T01:58:01.660 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosStatEC.ClusterStat 2024-04-24T01:58:01.660 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:182: Skipped 2024-04-24T01:58:01.660 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:58:01.660 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:196: Skipped 2024-04-24T01:58:01.660 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:58:01.660 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosStatEC.ClusterStat (0 ms) 2024-04-24T01:58:01.660 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosStatEC.PoolStat 2024-04-24T01:58:01.660 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:182: Skipped 2024-04-24T01:58:01.660 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:58:01.660 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:196: Skipped 2024-04-24T01:58:01.660 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:58:01.660 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosStatEC.PoolStat (0 ms) 2024-04-24T01:58:01.660 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:176: Skipped 2024-04-24T01:58:01.661 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:58:01.661 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 4 tests from LibRadosStatEC (0 ms total) 2024-04-24T01:58:01.661 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:58:01.661 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T01:58:01.661 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 9 tests from 2 test suites ran. (2984 ms total) 2024-04-24T01:58:01.661 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 5 tests. 2024-04-24T01:58:01.661 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] 4 tests, listed below: 2024-04-24T01:58:01.661 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosStatEC.Stat 2024-04-24T01:58:01.661 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosStatEC.StatNS 2024-04-24T01:58:01.661 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosStatEC.ClusterStat 2024-04-24T01:58:01.661 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosStatEC.PoolStat 2024-04-24T01:58:01.662 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-24T01:58:01.662 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T01:58:01.662 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_rados_api_stat_pp 2024-04-24T01:58:01.680 INFO:tasks.workunit.client.0.smithi057.stdout:Running main() from gmock_main.cc 2024-04-24T01:58:01.680 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 9 tests from 2 test suites. 2024-04-24T01:58:01.681 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T01:58:01.681 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 5 tests from LibRadosStatPP 2024-04-24T01:58:01.681 INFO:tasks.workunit.client.0.smithi057.stdout:seed 93825 2024-04-24T01:58:03.666 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosStatPP.StatPP 2024-04-24T01:58:04.076 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosStatPP.StatPP (409 ms) 2024-04-24T01:58:04.076 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-04-24T01:58:04.099 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosStatPP.Stat2Mtime2PP (24 ms) 2024-04-24T01:58:04.099 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosStatPP.ClusterStatPP 2024-04-24T01:58:04.099 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosStatPP.ClusterStatPP (0 ms) 2024-04-24T01:58:04.099 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosStatPP.PoolStatPP 2024-04-24T01:58:04.115 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosStatPP.PoolStatPP (16 ms) 2024-04-24T01:58:04.115 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosStatPP.StatPPNS 2024-04-24T01:58:04.163 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosStatPP.StatPPNS (47 ms) 2024-04-24T01:58:04.679 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 5 tests from LibRadosStatPP (496 ms total) 2024-04-24T01:58:04.680 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:58:04.680 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 4 tests from LibRadosStatECPP 2024-04-24T01:58:04.680 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:373: Skipped 2024-04-24T01:58:04.680 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:58:04.680 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosStatECPP.StatPP 2024-04-24T01:58:04.680 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:58:04.680 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:58:04.680 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:58:04.680 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:58:04.680 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosStatECPP.StatPP (0 ms) 2024-04-24T01:58:04.680 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosStatECPP.ClusterStatPP 2024-04-24T01:58:04.680 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:58:04.680 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:58:04.681 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:58:04.681 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:58:04.681 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosStatECPP.ClusterStatPP (0 ms) 2024-04-24T01:58:04.681 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosStatECPP.PoolStatPP 2024-04-24T01:58:04.681 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:58:04.681 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:58:04.681 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:58:04.681 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:58:04.681 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosStatECPP.PoolStatPP (0 ms) 2024-04-24T01:58:04.681 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosStatECPP.StatPPNS 2024-04-24T01:58:04.681 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:58:04.681 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:58:04.681 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:58:04.681 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:58:04.681 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosStatECPP.StatPPNS (0 ms) 2024-04-24T01:58:04.682 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:381: Skipped 2024-04-24T01:58:04.682 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:58:04.682 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 4 tests from LibRadosStatECPP (0 ms total) 2024-04-24T01:58:04.682 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:58:04.682 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T01:58:04.682 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 9 tests from 2 test suites ran. (2998 ms total) 2024-04-24T01:58:04.682 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 5 tests. 2024-04-24T01:58:04.682 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] 4 tests, listed below: 2024-04-24T01:58:04.682 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosStatECPP.StatPP 2024-04-24T01:58:04.682 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosStatECPP.ClusterStatPP 2024-04-24T01:58:04.682 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosStatECPP.PoolStatPP 2024-04-24T01:58:04.682 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosStatECPP.StatPPNS 2024-04-24T01:58:04.683 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-24T01:58:04.683 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T01:58:04.683 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_rados_api_watch_notify 2024-04-24T01:58:04.701 INFO:tasks.workunit.client.0.smithi057.stdout:Running main() from gmock_main.cc 2024-04-24T01:58:04.701 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 11 tests from 2 test suites. 2024-04-24T01:58:04.702 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T01:58:04.702 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 10 tests from LibRadosWatchNotify 2024-04-24T01:58:06.684 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify 2024-04-24T01:58:07.067 INFO:tasks.workunit.client.0.smithi057.stdout:watch_notify_test_cb 2024-04-24T01:58:07.100 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosWatchNotify.WatchNotify (417 ms) 2024-04-24T01:58:07.100 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosWatchNotify.Watch2Delete 2024-04-24T01:58:07.133 INFO:tasks.workunit.client.0.smithi057.stdout:waiting up to 300 for disconnect notification ... 2024-04-24T01:58:09.738 INFO:tasks.workunit.client.0.smithi057.stdout:watch_notify2_test_errcb cookie 40956000 err -107 2024-04-24T01:58:10.175 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosWatchNotify.Watch2Delete (3074 ms) 2024-04-24T01:58:10.175 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-04-24T01:58:10.208 INFO:tasks.workunit.client.0.smithi057.stdout:waiting up to 300 for disconnect notification ... 2024-04-24T01:58:14.739 INFO:tasks.workunit.client.0.smithi057.stdout:watch_notify2_test_errcb cookie 40967648 err -107 2024-04-24T01:58:15.217 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosWatchNotify.AioWatchDelete (5042 ms) 2024-04-24T01:58:15.217 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2 2024-04-24T01:58:15.243 INFO:tasks.workunit.client.0.smithi057.stdout:watch_notify2_test_cb from 15545 notify_id 1692217114625 cookie 40985136 2024-04-24T01:58:15.263 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2 (46 ms) 2024-04-24T01:58:15.263 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-04-24T01:58:15.291 INFO:tasks.workunit.client.0.smithi057.stdout:watch_notify2_test_cb from 15545 notify_id 1692217114624 cookie 40985136 2024-04-24T01:58:15.310 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosWatchNotify.AioWatchNotify2 (47 ms) 2024-04-24T01:58:15.310 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosWatchNotify.AioNotify 2024-04-24T01:58:15.336 INFO:tasks.workunit.client.0.smithi057.stdout:watch_notify2_test_cb from 15545 notify_id 1692217114624 cookie 40985136 2024-04-24T01:58:15.355 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosWatchNotify.AioNotify (45 ms) 2024-04-24T01:58:15.355 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-04-24T01:58:15.389 INFO:tasks.workunit.client.0.smithi057.stdout:watch_notify2_test_cb from 15545 notify_id 1692217114625 cookie 40985136 2024-04-24T01:58:15.389 INFO:tasks.workunit.client.0.smithi057.stdout:watch_notify2_test_cb from 15545 notify_id 1692217114625 cookie 41004064 2024-04-24T01:58:15.415 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2Multi (60 ms) 2024-04-24T01:58:15.415 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-04-24T01:58:15.440 INFO:tasks.workunit.client.0.smithi057.stdout:watch_notify2_test_cb from 15545 notify_id 1692217114625 cookie 40985136 2024-04-24T01:58:18.440 INFO:tasks.workunit.client.0.smithi057.stdout:watch_notify2_test_cb from 15545 notify_id 1692217114626 cookie 40985136 2024-04-24T01:58:18.463 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3048 ms) 2024-04-24T01:58:18.463 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-04-24T01:58:18.488 INFO:tasks.workunit.client.0.smithi057.stdout:waiting up to 1024 for osd to time us out ... 2024-04-24T01:58:22.496 INFO:tasks.workunit.client.0.smithi057.stdout:watch_notify2_test_errcb cookie 40985136 err -107 2024-04-24T01:58:23.517 INFO:tasks.workunit.client.0.smithi057.stdout:watch_notify2_test_cb from 15545 notify_id 1692217114627 cookie 40985136 2024-04-24T01:58:23.534 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosWatchNotify.Watch3Timeout (5071 ms) 2024-04-24T01:58:23.534 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-04-24T01:58:23.571 INFO:tasks.workunit.client.0.smithi057.stdout:waiting up to 30 for disconnect notification ... 2024-04-24T01:58:24.741 INFO:tasks.workunit.client.0.smithi057.stdout:watch_notify2_test_errcb cookie 40985136 err -107 2024-04-24T01:58:25.580 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosWatchNotify.AioWatchDelete2 (2046 ms) 2024-04-24T01:58:25.742 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 10 tests from LibRadosWatchNotify (18896 ms total) 2024-04-24T01:58:25.742 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:58:25.742 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 1 test from LibRadosWatchNotifyEC 2024-04-24T01:58:25.742 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:168: Skipped 2024-04-24T01:58:25.743 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:58:25.743 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-04-24T01:58:25.743 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:182: Skipped 2024-04-24T01:58:25.743 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:58:25.743 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:196: Skipped 2024-04-24T01:58:25.743 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:58:25.743 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify (0 ms) 2024-04-24T01:58:25.743 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/TestCase.cc:176: Skipped 2024-04-24T01:58:25.743 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:58:25.744 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 1 test from LibRadosWatchNotifyEC (0 ms total) 2024-04-24T01:58:25.744 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:58:25.744 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T01:58:25.744 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 11 tests from 2 test suites ran. (21040 ms total) 2024-04-24T01:58:25.744 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 10 tests. 2024-04-24T01:58:25.744 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] 1 test, listed below: 2024-04-24T01:58:25.744 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosWatchNotifyEC.WatchNotify 2024-04-24T01:58:25.744 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-24T01:58:25.745 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T01:58:25.745 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_rados_api_watch_notify_pp 2024-04-24T01:58:25.766 INFO:tasks.workunit.client.0.smithi057.stdout:Running main() from gmock_main.cc 2024-04-24T01:58:25.766 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 16 tests from 2 test suites. 2024-04-24T01:58:25.766 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T01:58:25.766 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 2 tests from LibRadosWatchNotifyECPP 2024-04-24T01:58:25.766 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:373: Skipped 2024-04-24T01:58:25.767 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:58:25.767 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-04-24T01:58:25.767 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:58:25.767 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:58:25.767 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:58:25.767 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:58:25.767 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify (0 ms) 2024-04-24T01:58:25.767 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-04-24T01:58:25.767 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:387: Skipped 2024-04-24T01:58:25.767 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:58:25.767 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:400: Skipped 2024-04-24T01:58:25.767 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:58:25.767 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (0 ms) 2024-04-24T01:58:25.767 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/testcase_cxx.cc:381: Skipped 2024-04-24T01:58:25.768 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T01:58:25.768 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 2 tests from LibRadosWatchNotifyECPP (0 ms total) 2024-04-24T01:58:25.768 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:58:25.768 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-04-24T01:58:27.759 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-04-24T01:58:28.167 INFO:tasks.workunit.client.0.smithi057.stdout:notify 2024-04-24T01:58:28.180 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (421 ms) 2024-04-24T01:58:28.180 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-04-24T01:58:28.206 INFO:tasks.workunit.client.0.smithi057.stdout:notify 2024-04-24T01:58:28.219 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (40 ms) 2024-04-24T01:58:28.219 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-04-24T01:58:28.247 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (27 ms) 2024-04-24T01:58:28.247 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-04-24T01:58:28.281 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (34 ms) 2024-04-24T01:58:28.281 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-04-24T01:58:28.308 INFO:tasks.workunit.client.0.smithi057.stdout:handle_notify cookie 28222064 notify_id 1705102016514 notifier_gid 15548 2024-04-24T01:58:28.320 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (40 ms) 2024-04-24T01:58:28.321 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-04-24T01:58:28.346 INFO:tasks.workunit.client.0.smithi057.stdout:handle_notify cookie 28222064 notify_id 1705102016515 notifier_gid 15548 2024-04-24T01:58:28.359 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (38 ms) 2024-04-24T01:58:28.359 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-04-24T01:58:28.386 INFO:tasks.workunit.client.0.smithi057.stdout:handle_notify cookie 28222064 notify_id 1705102016516 notifier_gid 15548 2024-04-24T01:58:28.400 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (41 ms) 2024-04-24T01:58:28.400 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-04-24T01:58:28.427 INFO:tasks.workunit.client.0.smithi057.stdout:handle_notify cookie 28224992 notify_id 1705102016517 notifier_gid 15548 2024-04-24T01:58:28.440 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (40 ms) 2024-04-24T01:58:28.440 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-04-24T01:58:28.469 INFO:tasks.workunit.client.0.smithi057.stdout:handle_notify cookie 28227920 notify_id 1705102016515 notifier_gid 15548 2024-04-24T01:58:28.485 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (45 ms) 2024-04-24T01:58:28.485 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-04-24T01:58:28.513 INFO:tasks.workunit.client.0.smithi057.stdout:handle_notify cookie 28245232 notify_id 1705102016518 notifier_gid 15548 2024-04-24T01:58:28.526 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (41 ms) 2024-04-24T01:58:28.526 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-04-24T01:58:28.555 INFO:tasks.workunit.client.0.smithi057.stdout: trying... 2024-04-24T01:58:28.559 INFO:tasks.workunit.client.0.smithi057.stdout:handle_notify cookie 28245232 notify_id 1705102016514 notifier_gid 15548 2024-04-24T01:58:29.558 INFO:tasks.workunit.client.0.smithi057.stdout: timed out 2024-04-24T01:58:29.571 INFO:tasks.workunit.client.0.smithi057.stdout: flushing 2024-04-24T01:58:31.560 INFO:tasks.workunit.client.0.smithi057.stdout: flushed 2024-04-24T01:58:31.560 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3034 ms) 2024-04-24T01:58:31.560 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-04-24T01:58:31.590 INFO:tasks.workunit.client.0.smithi057.stdout: trying... 2024-04-24T01:58:31.594 INFO:tasks.workunit.client.0.smithi057.stdout:handle_notify cookie 28259824 notify_id 1705102016516 notifier_gid 15548 2024-04-24T01:58:32.592 INFO:tasks.workunit.client.0.smithi057.stdout: timed out 2024-04-24T01:58:32.604 INFO:tasks.workunit.client.0.smithi057.stdout: flushing 2024-04-24T01:58:34.594 INFO:tasks.workunit.client.0.smithi057.stdout: flushed 2024-04-24T01:58:34.595 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3034 ms) 2024-04-24T01:58:34.595 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-04-24T01:58:34.625 INFO:tasks.workunit.client.0.smithi057.stdout:List watches 2024-04-24T01:58:34.625 INFO:tasks.workunit.client.0.smithi057.stdout:notify2 2024-04-24T01:58:34.628 INFO:tasks.workunit.client.0.smithi057.stdout:handle_notify cookie 28259824 notify_id 1705102016515 notifier_gid 15548 2024-04-24T01:58:37.635 INFO:tasks.workunit.client.0.smithi057.stdout:notify2 done 2024-04-24T01:58:37.635 INFO:tasks.workunit.client.0.smithi057.stdout:watch_check 2024-04-24T01:58:37.635 INFO:tasks.workunit.client.0.smithi057.stdout:unwatch2 2024-04-24T01:58:37.648 INFO:tasks.workunit.client.0.smithi057.stdout: flushing 2024-04-24T01:58:37.648 INFO:tasks.workunit.client.0.smithi057.stdout:done 2024-04-24T01:58:37.648 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3054 ms) 2024-04-24T01:58:37.648 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-04-24T01:58:37.676 INFO:tasks.workunit.client.0.smithi057.stdout:List watches 2024-04-24T01:58:37.676 INFO:tasks.workunit.client.0.smithi057.stdout:notify2 2024-04-24T01:58:37.680 INFO:tasks.workunit.client.0.smithi057.stdout:handle_notify cookie 28259824 notify_id 1709396983812 notifier_gid 15548 2024-04-24T01:58:40.686 INFO:tasks.workunit.client.0.smithi057.stdout:notify2 done 2024-04-24T01:58:40.686 INFO:tasks.workunit.client.0.smithi057.stdout:watch_check 2024-04-24T01:58:40.686 INFO:tasks.workunit.client.0.smithi057.stdout:unwatch2 2024-04-24T01:58:40.699 INFO:tasks.workunit.client.0.smithi057.stdout: flushing 2024-04-24T01:58:40.699 INFO:tasks.workunit.client.0.smithi057.stdout:done 2024-04-24T01:58:40.699 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3051 ms) 2024-04-24T01:58:40.803 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (12940 ms total) 2024-04-24T01:58:40.803 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:58:40.803 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T01:58:40.803 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 16 tests from 2 test suites ran. (15037 ms total) 2024-04-24T01:58:40.803 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 14 tests. 2024-04-24T01:58:40.803 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] 2 tests, listed below: 2024-04-24T01:58:40.803 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotify 2024-04-24T01:58:40.803 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-04-24T01:58:40.805 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-24T01:58:40.805 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T01:58:40.805 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_rados_api_cmd 2024-04-24T01:58:40.827 INFO:tasks.workunit.client.0.smithi057.stdout:Running main() from gmock_main.cc 2024-04-24T01:58:40.827 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 4 tests from 1 test suite. 2024-04-24T01:58:40.827 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T01:58:40.827 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 4 tests from LibRadosCmd 2024-04-24T01:58:40.827 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosCmd.MonDescribe 2024-04-24T01:58:40.866 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosCmd.MonDescribe (39 ms) 2024-04-24T01:58:40.866 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosCmd.OSDCmd 2024-04-24T01:58:40.902 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosCmd.OSDCmd (36 ms) 2024-04-24T01:58:40.902 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosCmd.PGCmd 2024-04-24T01:58:43.832 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosCmd.PGCmd (2930 ms) 2024-04-24T01:58:43.832 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosCmd.WatchLog 2024-04-24T01:58:43.858 INFO:tasks.workunit.client.0.smithi057.stdout:got: 2024-04-24T01:58:42.805418+0000 mon.a [INF] from='client.? 172.21.15.57:0/2299603198' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi057-93882-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-04-24T01:58:44.829 INFO:tasks.workunit.client.0.smithi057.stdout:got: 2024-04-24T01:58:43.858973+0000 client.admin [INF] onexx 2024-04-24T01:58:44.829 INFO:tasks.workunit.client.0.smithi057.stdout:got: 2024-04-24T01:58:43.859140+0000 mon.a [INF] from='client.? 172.21.15.57:0/3123894822' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-04-24T01:58:48.836 INFO:tasks.workunit.client.0.smithi057.stdout:got: 2024-04-24T01:58:46.836094+0000 mon.a [INF] from='client.? 172.21.15.57:0/3123894822' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-04-24T01:58:48.851 INFO:tasks.workunit.client.0.smithi057.stdout:got: 2024-04-24T01:58:48.836898+0000 client.admin [INF] threexx 2024-04-24T01:58:48.851 INFO:tasks.workunit.client.0.smithi057.stdout:got: 2024-04-24T01:58:48.837202+0000 mon.a [INF] from='client.? 172.21.15.57:0/3123894822' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-04-24T01:58:52.861 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosCmd.WatchLog (9029 ms) 2024-04-24T01:58:52.861 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 4 tests from LibRadosCmd (12034 ms total) 2024-04-24T01:58:52.861 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:58:52.862 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T01:58:52.862 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 4 tests from 1 test suite ran. (12034 ms total) 2024-04-24T01:58:52.862 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 4 tests. 2024-04-24T01:58:52.864 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-24T01:58:52.864 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T01:58:52.864 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_rados_api_cmd_pp 2024-04-24T01:58:52.887 INFO:tasks.workunit.client.0.smithi057.stdout:Running main() from gmock_main.cc 2024-04-24T01:58:52.887 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 3 tests from 1 test suite. 2024-04-24T01:58:52.887 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T01:58:52.887 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 3 tests from LibRadosCmd 2024-04-24T01:58:52.887 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosCmd.MonDescribePP 2024-04-24T01:58:52.923 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosCmd.MonDescribePP (37 ms) 2024-04-24T01:58:52.924 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosCmd.OSDCmdPP 2024-04-24T01:58:52.959 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosCmd.OSDCmdPP (35 ms) 2024-04-24T01:58:52.959 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosCmd.PGCmdPP 2024-04-24T01:58:55.073 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosCmd.PGCmdPP (2113 ms) 2024-04-24T01:58:55.073 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 3 tests from LibRadosCmd (2186 ms total) 2024-04-24T01:58:55.073 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:58:55.073 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T01:58:55.073 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 3 tests from 1 test suite ran. (2186 ms total) 2024-04-24T01:58:55.073 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 3 tests. 2024-04-24T01:58:55.075 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-24T01:58:55.075 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T01:58:55.075 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_rados_api_service 2024-04-24T01:58:55.107 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:58:55.106+0000 7f5465a76840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:58:55.107 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:58:55.107+0000 7f5465a76840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:58:55.107 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:58:55.107+0000 7f5465a76840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:58:55.107 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 4 tests from 1 test suite. 2024-04-24T01:58:55.107 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T01:58:55.107 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 4 tests from LibRadosService 2024-04-24T01:58:55.108 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosService.RegisterEarly 2024-04-24T01:59:00.142 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosService.RegisterEarly (5035 ms) 2024-04-24T01:59:00.142 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosService.RegisterLate 2024-04-24T01:59:00.172 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosService.RegisterLate (31 ms) 2024-04-24T01:59:00.172 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosService.StatusFormat 2024-04-24T01:59:00.332 INFO:tasks.workunit.client.0.smithi057.stdout: cluster: 2024-04-24T01:59:00.332 INFO:tasks.workunit.client.0.smithi057.stdout: id: 2097e8c9-9d10-45f4-a30f-1b3cf153e5e6 2024-04-24T01:59:00.332 INFO:tasks.workunit.client.0.smithi057.stdout: health: HEALTH_WARN 2024-04-24T01:59:00.332 INFO:tasks.workunit.client.0.smithi057.stdout: 1 pool(s) do not have an application enabled 2024-04-24T01:59:00.333 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:59:00.333 INFO:tasks.workunit.client.0.smithi057.stdout: services: 2024-04-24T01:59:00.333 INFO:tasks.workunit.client.0.smithi057.stdout: mon: 1 daemons, quorum a (age 10m) 2024-04-24T01:59:00.333 INFO:tasks.workunit.client.0.smithi057.stdout: mgr: x(active, since 10m) 2024-04-24T01:59:00.333 INFO:tasks.workunit.client.0.smithi057.stdout: osd: 4 osds: 4 up (since 10m), 4 in (since 10m) 2024-04-24T01:59:00.333 INFO:tasks.workunit.client.0.smithi057.stdout: laundry: 1 daemon active (1 hosts) 2024-04-24T01:59:00.333 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:59:00.333 INFO:tasks.workunit.client.0.smithi057.stdout: data: 2024-04-24T01:59:00.333 INFO:tasks.workunit.client.0.smithi057.stdout: pools: 3 pools, 41 pgs 2024-04-24T01:59:00.333 INFO:tasks.workunit.client.0.smithi057.stdout: objects: 3 objects, 577 KiB 2024-04-24T01:59:00.333 INFO:tasks.workunit.client.0.smithi057.stdout: usage: 161 MiB used, 400 GiB / 400 GiB avail 2024-04-24T01:59:00.333 INFO:tasks.workunit.client.0.smithi057.stdout: pgs: 41 active+clean 2024-04-24T01:59:00.333 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:59:00.333 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:59:02.364 INFO:tasks.workunit.client.0.smithi057.stdout: cluster: 2024-04-24T01:59:02.365 INFO:tasks.workunit.client.0.smithi057.stdout: id: 2097e8c9-9d10-45f4-a30f-1b3cf153e5e6 2024-04-24T01:59:02.365 INFO:tasks.workunit.client.0.smithi057.stdout: health: HEALTH_WARN 2024-04-24T01:59:02.365 INFO:tasks.workunit.client.0.smithi057.stdout: 1 pool(s) do not have an application enabled 2024-04-24T01:59:02.365 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:59:02.365 INFO:tasks.workunit.client.0.smithi057.stdout: services: 2024-04-24T01:59:02.365 INFO:tasks.workunit.client.0.smithi057.stdout: mon: 1 daemons, quorum a (age 10m) 2024-04-24T01:59:02.365 INFO:tasks.workunit.client.0.smithi057.stdout: mgr: x(active, since 10m) 2024-04-24T01:59:02.365 INFO:tasks.workunit.client.0.smithi057.stdout: osd: 4 osds: 4 up (since 10m), 4 in (since 10m) 2024-04-24T01:59:02.365 INFO:tasks.workunit.client.0.smithi057.stdout: foo: 16 portals active (1 hosts, 3 zones) 2024-04-24T01:59:02.365 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:59:02.365 INFO:tasks.workunit.client.0.smithi057.stdout: data: 2024-04-24T01:59:02.365 INFO:tasks.workunit.client.0.smithi057.stdout: pools: 3 pools, 41 pgs 2024-04-24T01:59:02.365 INFO:tasks.workunit.client.0.smithi057.stdout: objects: 3 objects, 577 KiB 2024-04-24T01:59:02.366 INFO:tasks.workunit.client.0.smithi057.stdout: usage: 164 MiB used, 400 GiB / 400 GiB avail 2024-04-24T01:59:02.366 INFO:tasks.workunit.client.0.smithi057.stdout: pgs: 41 active+clean 2024-04-24T01:59:02.366 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:59:02.366 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:59:02.387 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosService.StatusFormat (2215 ms) 2024-04-24T01:59:02.387 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosService.Status 2024-04-24T01:59:23.418 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosService.Status (21030 ms) 2024-04-24T01:59:23.418 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 4 tests from LibRadosService (28311 ms total) 2024-04-24T01:59:23.418 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:59:23.418 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T01:59:23.418 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 4 tests from 1 test suite ran. (28311 ms total) 2024-04-24T01:59:23.418 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 4 tests. 2024-04-24T01:59:23.423 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-24T01:59:23.423 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T01:59:23.423 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_rados_api_service_pp 2024-04-24T01:59:23.458 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:59:23.456+0000 7fb33a68b840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:59:23.458 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:59:23.456+0000 7fb33a68b840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:59:23.458 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T01:59:23.457+0000 7fb33a68b840 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T01:59:23.458 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 4 tests from 1 test suite. 2024-04-24T01:59:23.458 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T01:59:23.459 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 4 tests from LibRadosServicePP 2024-04-24T01:59:23.459 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosServicePP.RegisterEarly 2024-04-24T01:59:28.488 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosServicePP.RegisterEarly (5030 ms) 2024-04-24T01:59:28.488 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosServicePP.RegisterLate 2024-04-24T01:59:28.535 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosServicePP.RegisterLate (47 ms) 2024-04-24T01:59:28.535 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosServicePP.Status 2024-04-24T01:59:48.566 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosServicePP.Status (20031 ms) 2024-04-24T01:59:48.566 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosServicePP.Close 2024-04-24T01:59:48.567 INFO:tasks.workunit.client.0.smithi057.stdout:attempt 0 of 20 2024-04-24T01:59:53.627 INFO:tasks.workunit.client.0.smithi057.stdout: failed to deregister: 2024-04-24T01:59:53.627 INFO:tasks.workunit.client.0.smithi057.stdout:{ 2024-04-24T01:59:53.627 INFO:tasks.workunit.client.0.smithi057.stdout: "epoch": 9, 2024-04-24T01:59:53.627 INFO:tasks.workunit.client.0.smithi057.stdout: "modified": "2024-04-24T01:59:49.067261+0000", 2024-04-24T01:59:53.627 INFO:tasks.workunit.client.0.smithi057.stdout: "services": { 2024-04-24T01:59:53.628 INFO:tasks.workunit.client.0.smithi057.stdout: "laundry": { 2024-04-24T01:59:53.628 INFO:tasks.workunit.client.0.smithi057.stdout: "daemons": { 2024-04-24T01:59:53.628 INFO:tasks.workunit.client.0.smithi057.stdout: "summary": "", 2024-04-24T01:59:53.628 INFO:tasks.workunit.client.0.smithi057.stdout: "close-test-pid94335": { 2024-04-24T01:59:53.628 INFO:tasks.workunit.client.0.smithi057.stdout: "start_epoch": 9, 2024-04-24T01:59:53.628 INFO:tasks.workunit.client.0.smithi057.stdout: "start_stamp": "2024-04-24T01:59:48.596411+0000", 2024-04-24T01:59:53.628 INFO:tasks.workunit.client.0.smithi057.stdout: "gid": 15643, 2024-04-24T01:59:53.628 INFO:tasks.workunit.client.0.smithi057.stdout: "addr": "172.21.15.57:0/2657163926", 2024-04-24T01:59:53.628 INFO:tasks.workunit.client.0.smithi057.stdout: "metadata": { 2024-04-24T01:59:53.628 INFO:tasks.workunit.client.0.smithi057.stdout: "arch": "x86_64", 2024-04-24T01:59:53.628 INFO:tasks.workunit.client.0.smithi057.stdout: "ceph_release": "squid", 2024-04-24T01:59:53.628 INFO:tasks.workunit.client.0.smithi057.stdout: "ceph_version": "ceph version 19.0.0-3227-g424d8c43 (424d8c4389b684b0a4d72510e1b4d398d8e6c8f4) squid (dev)", 2024-04-24T01:59:53.628 INFO:tasks.workunit.client.0.smithi057.stdout: "ceph_version_short": "19.0.0-3227-g424d8c43", 2024-04-24T01:59:53.628 INFO:tasks.workunit.client.0.smithi057.stdout: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2024-04-24T01:59:53.629 INFO:tasks.workunit.client.0.smithi057.stdout: "distro": "centos", 2024-04-24T01:59:53.629 INFO:tasks.workunit.client.0.smithi057.stdout: "distro_description": "CentOS Stream 9", 2024-04-24T01:59:53.629 INFO:tasks.workunit.client.0.smithi057.stdout: "distro_version": "9", 2024-04-24T01:59:53.629 INFO:tasks.workunit.client.0.smithi057.stdout: "foo": "bar", 2024-04-24T01:59:53.629 INFO:tasks.workunit.client.0.smithi057.stdout: "hostname": "smithi057", 2024-04-24T01:59:53.629 INFO:tasks.workunit.client.0.smithi057.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Tue Apr 9 12:57:02 UTC 2024", 2024-04-24T01:59:53.629 INFO:tasks.workunit.client.0.smithi057.stdout: "kernel_version": "5.14.0-437.el9.x86_64", 2024-04-24T01:59:53.629 INFO:tasks.workunit.client.0.smithi057.stdout: "mem_swap_kb": "0", 2024-04-24T01:59:53.629 INFO:tasks.workunit.client.0.smithi057.stdout: "mem_total_kb": "32494648", 2024-04-24T01:59:53.629 INFO:tasks.workunit.client.0.smithi057.stdout: "os": "Linux", 2024-04-24T01:59:53.629 INFO:tasks.workunit.client.0.smithi057.stdout: "this": "that" 2024-04-24T01:59:53.629 INFO:tasks.workunit.client.0.smithi057.stdout: }, 2024-04-24T01:59:53.629 INFO:tasks.workunit.client.0.smithi057.stdout: "task_status": {} 2024-04-24T01:59:53.629 INFO:tasks.workunit.client.0.smithi057.stdout: }, 2024-04-24T01:59:53.629 INFO:tasks.workunit.client.0.smithi057.stdout: "pid94000": { 2024-04-24T01:59:53.630 INFO:tasks.workunit.client.0.smithi057.stdout: "start_epoch": 6, 2024-04-24T01:59:53.630 INFO:tasks.workunit.client.0.smithi057.stdout: "start_stamp": "2024-04-24T01:59:22.418747+0000", 2024-04-24T01:59:53.630 INFO:tasks.workunit.client.0.smithi057.stdout: "gid": 15631, 2024-04-24T01:59:53.630 INFO:tasks.workunit.client.0.smithi057.stdout: "addr": "172.21.15.57:0/1890856138", 2024-04-24T01:59:53.630 INFO:tasks.workunit.client.0.smithi057.stdout: "metadata": { 2024-04-24T01:59:53.630 INFO:tasks.workunit.client.0.smithi057.stdout: "arch": "x86_64", 2024-04-24T01:59:53.630 INFO:tasks.workunit.client.0.smithi057.stdout: "ceph_release": "squid", 2024-04-24T01:59:53.630 INFO:tasks.workunit.client.0.smithi057.stdout: "ceph_version": "ceph version 19.0.0-3227-g424d8c43 (424d8c4389b684b0a4d72510e1b4d398d8e6c8f4) squid (dev)", 2024-04-24T01:59:53.630 INFO:tasks.workunit.client.0.smithi057.stdout: "ceph_version_short": "19.0.0-3227-g424d8c43", 2024-04-24T01:59:53.630 INFO:tasks.workunit.client.0.smithi057.stdout: "cpu": "Intel(R) Xeon(R) CPU E5-1620 v3 @ 3.50GHz", 2024-04-24T01:59:53.630 INFO:tasks.workunit.client.0.smithi057.stdout: "distro": "centos", 2024-04-24T01:59:53.630 INFO:tasks.workunit.client.0.smithi057.stdout: "distro_description": "CentOS Stream 9", 2024-04-24T01:59:53.630 INFO:tasks.workunit.client.0.smithi057.stdout: "distro_version": "9", 2024-04-24T01:59:53.630 INFO:tasks.workunit.client.0.smithi057.stdout: "foo": "bar", 2024-04-24T01:59:53.631 INFO:tasks.workunit.client.0.smithi057.stdout: "hostname": "smithi057", 2024-04-24T01:59:53.631 INFO:tasks.workunit.client.0.smithi057.stdout: "kernel_description": "#1 SMP PREEMPT_DYNAMIC Tue Apr 9 12:57:02 UTC 2024", 2024-04-24T01:59:53.631 INFO:tasks.workunit.client.0.smithi057.stdout: "kernel_version": "5.14.0-437.el9.x86_64", 2024-04-24T01:59:53.631 INFO:tasks.workunit.client.0.smithi057.stdout: "mem_swap_kb": "0", 2024-04-24T01:59:53.631 INFO:tasks.workunit.client.0.smithi057.stdout: "mem_total_kb": "32494648", 2024-04-24T01:59:53.631 INFO:tasks.workunit.client.0.smithi057.stdout: "os": "Linux", 2024-04-24T01:59:53.631 INFO:tasks.workunit.client.0.smithi057.stdout: "this": "that" 2024-04-24T01:59:53.631 INFO:tasks.workunit.client.0.smithi057.stdout: }, 2024-04-24T01:59:53.631 INFO:tasks.workunit.client.0.smithi057.stdout: "task_status": {} 2024-04-24T01:59:53.631 INFO:tasks.workunit.client.0.smithi057.stdout: } 2024-04-24T01:59:53.631 INFO:tasks.workunit.client.0.smithi057.stdout: } 2024-04-24T01:59:53.631 INFO:tasks.workunit.client.0.smithi057.stdout: } 2024-04-24T01:59:53.631 INFO:tasks.workunit.client.0.smithi057.stdout: } 2024-04-24T01:59:53.631 INFO:tasks.workunit.client.0.smithi057.stdout:} 2024-04-24T01:59:53.631 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:59:53.631 INFO:tasks.workunit.client.0.smithi057.stdout:attempt 1 of 20 2024-04-24T01:59:58.686 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosServicePP.Close (10120 ms) 2024-04-24T01:59:58.686 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 4 tests from LibRadosServicePP (35228 ms total) 2024-04-24T01:59:58.686 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:59:58.686 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T01:59:58.686 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 4 tests from 1 test suite ran. (35228 ms total) 2024-04-24T01:59:58.687 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 4 tests. 2024-04-24T01:59:58.688 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-24T01:59:58.688 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T01:59:58.689 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_rados_api_c_write_operations 2024-04-24T01:59:58.709 INFO:tasks.workunit.client.0.smithi057.stdout:Running main() from gmock_main.cc 2024-04-24T01:59:58.709 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 8 tests from 2 test suites. 2024-04-24T01:59:58.709 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T01:59:58.709 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 1 test from LibradosCWriteOps 2024-04-24T01:59:58.709 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibradosCWriteOps.NewDelete 2024-04-24T01:59:58.709 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibradosCWriteOps.NewDelete (0 ms) 2024-04-24T01:59:58.709 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 1 test from LibradosCWriteOps (0 ms total) 2024-04-24T01:59:58.709 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T01:59:58.709 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 7 tests from LibRadosCWriteOps 2024-04-24T01:59:58.709 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosCWriteOps.assertExists 2024-04-24T02:00:01.763 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosCWriteOps.assertExists (3054 ms) 2024-04-24T02:00:01.763 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2024-04-24T02:00:04.787 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosCWriteOps.WriteOpAssertVersion (3025 ms) 2024-04-24T02:00:04.788 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosCWriteOps.Xattrs 2024-04-24T02:00:07.824 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosCWriteOps.Xattrs (3036 ms) 2024-04-24T02:00:07.824 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosCWriteOps.Write 2024-04-24T02:00:10.823 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosCWriteOps.Write (2999 ms) 2024-04-24T02:00:10.823 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosCWriteOps.Exec 2024-04-24T02:00:13.845 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosCWriteOps.Exec (3022 ms) 2024-04-24T02:00:13.845 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosCWriteOps.WriteSame 2024-04-24T02:00:16.857 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosCWriteOps.WriteSame (3012 ms) 2024-04-24T02:00:16.857 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] LibRadosCWriteOps.CmpExt 2024-04-24T02:00:26.666 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] LibRadosCWriteOps.CmpExt (9809 ms) 2024-04-24T02:00:26.666 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 7 tests from LibRadosCWriteOps (27957 ms total) 2024-04-24T02:00:26.666 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T02:00:26.666 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T02:00:26.666 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 8 tests from 2 test suites ran. (27957 ms total) 2024-04-24T02:00:26.666 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 8 tests. 2024-04-24T02:00:26.667 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-24T02:00:26.667 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T02:00:26.667 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_rados_api_c_read_operations 2024-04-24T02:00:26.693 INFO:tasks.workunit.client.0.smithi057.stdout:Running main() from gmock_main.cc 2024-04-24T02:00:26.693 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 17 tests from 1 test suite. 2024-04-24T02:00:26.693 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T02:00:26.693 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 17 tests from CReadOpsTest 2024-04-24T02:00:28.692 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] CReadOpsTest.NewDelete 2024-04-24T02:00:28.692 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] CReadOpsTest.NewDelete (0 ms) 2024-04-24T02:00:28.693 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] CReadOpsTest.SetOpFlags 2024-04-24T02:00:29.108 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] CReadOpsTest.SetOpFlags (416 ms) 2024-04-24T02:00:29.108 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] CReadOpsTest.AssertExists 2024-04-24T02:00:29.158 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] CReadOpsTest.AssertExists (51 ms) 2024-04-24T02:00:29.158 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] CReadOpsTest.AssertVersion 2024-04-24T02:00:29.197 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] CReadOpsTest.AssertVersion (39 ms) 2024-04-24T02:00:29.197 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] CReadOpsTest.CmpXattr 2024-04-24T02:00:29.366 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] CReadOpsTest.CmpXattr (168 ms) 2024-04-24T02:00:29.366 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] CReadOpsTest.Read 2024-04-24T02:00:29.413 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] CReadOpsTest.Read (47 ms) 2024-04-24T02:00:29.413 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] CReadOpsTest.Checksum 2024-04-24T02:00:29.451 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] CReadOpsTest.Checksum (38 ms) 2024-04-24T02:00:29.451 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] CReadOpsTest.RWOrderedRead 2024-04-24T02:00:29.480 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] CReadOpsTest.RWOrderedRead (30 ms) 2024-04-24T02:00:29.481 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] CReadOpsTest.ShortRead 2024-04-24T02:00:29.518 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] CReadOpsTest.ShortRead (37 ms) 2024-04-24T02:00:29.518 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] CReadOpsTest.Exec 2024-04-24T02:00:29.541 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] CReadOpsTest.Exec (23 ms) 2024-04-24T02:00:29.541 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] CReadOpsTest.ExecUserBuf 2024-04-24T02:00:29.575 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] CReadOpsTest.ExecUserBuf (33 ms) 2024-04-24T02:00:29.575 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] CReadOpsTest.Stat 2024-04-24T02:00:29.610 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] CReadOpsTest.Stat (35 ms) 2024-04-24T02:00:29.610 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] CReadOpsTest.Stat2 2024-04-24T02:00:29.643 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] CReadOpsTest.Stat2 (32 ms) 2024-04-24T02:00:29.643 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] CReadOpsTest.Omap 2024-04-24T02:00:29.834 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] CReadOpsTest.Omap (191 ms) 2024-04-24T02:00:29.834 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] CReadOpsTest.OmapNuls 2024-04-24T02:00:29.910 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] CReadOpsTest.OmapNuls (76 ms) 2024-04-24T02:00:29.910 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] CReadOpsTest.GetXattrs 2024-04-24T02:00:29.972 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] CReadOpsTest.GetXattrs (63 ms) 2024-04-24T02:00:29.972 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] CReadOpsTest.CmpExt 2024-04-24T02:00:30.001 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] CReadOpsTest.CmpExt (29 ms) 2024-04-24T02:00:30.704 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 17 tests from CReadOpsTest (1310 ms total) 2024-04-24T02:00:30.704 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T02:00:30.704 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T02:00:30.704 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 17 tests from 1 test suite ran. (4011 ms total) 2024-04-24T02:00:30.704 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 17 tests. 2024-04-24T02:00:30.706 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-24T02:00:30.706 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T02:00:30.706 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_rados_api_cls_remote_reads 2024-04-24T02:00:30.745 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:00:30.744+0000 7f5a1ac326c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:00:30.745 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:00:30.744+0000 7f5a1ac326c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:00:30.745 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:00:30.744+0000 7f5a1ac326c0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:00:30.746 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 1 test from 1 test suite. 2024-04-24T02:00:30.746 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T02:00:30.746 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 1 test from ClsTestRemoteReads 2024-04-24T02:00:30.746 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] ClsTestRemoteReads.TestGather 2024-04-24T02:00:30.746 INFO:tasks.workunit.client.0.smithi057.stdout:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-3227-g424d8c43/rpm/el9/BUILD/ceph-19.0.0-3227-g424d8c43/src/test/librados/cls_remote_reads.cc:13: Skipped 2024-04-24T02:00:30.746 INFO:tasks.workunit.client.0.smithi057.stdout:Not supported by crimson yet. Skipped 2024-04-24T02:00:30.746 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] ClsTestRemoteReads.TestGather (0 ms) 2024-04-24T02:00:30.746 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 1 test from ClsTestRemoteReads (0 ms total) 2024-04-24T02:00:30.747 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T02:00:30.747 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T02:00:30.747 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 1 test from 1 test suite ran. (0 ms total) 2024-04-24T02:00:30.747 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 0 tests. 2024-04-24T02:00:30.747 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] 1 test, listed below: 2024-04-24T02:00:30.747 INFO:tasks.workunit.client.0.smithi057.stdout:[ SKIPPED ] ClsTestRemoteReads.TestGather 2024-04-24T02:00:30.748 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-24T02:00:30.748 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T02:00:30.748 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_rados_list_parallel 2024-04-24T02:00:33.609 INFO:tasks.workunit.client.0.smithi057.stdout:process_1_[94596]: starting. 2024-04-24T02:00:33.609 INFO:tasks.workunit.client.0.smithi057.stdout:process_1_[94596]: creating pool ceph_test_rados_list_parallel.smithi057-94595 2024-04-24T02:00:33.609 INFO:tasks.workunit.client.0.smithi057.stdout:process_1_[94596]: created object 0... 2024-04-24T02:00:33.609 INFO:tasks.workunit.client.0.smithi057.stdout:process_1_[94596]: created object 25... 2024-04-24T02:00:33.609 INFO:tasks.workunit.client.0.smithi057.stdout:process_1_[94596]: created object 49... 2024-04-24T02:00:33.609 INFO:tasks.workunit.client.0.smithi057.stdout:process_1_[94596]: finishing. 2024-04-24T02:00:33.609 INFO:tasks.workunit.client.0.smithi057.stdout:process_1_[94596]: shutting down. 2024-04-24T02:00:33.803 INFO:tasks.workunit.client.0.smithi057.stdout:process_2_[94597]: starting. 2024-04-24T02:00:33.804 INFO:tasks.workunit.client.0.smithi057.stdout:process_2_[94597]: listing objects. 2024-04-24T02:00:33.804 INFO:tasks.workunit.client.0.smithi057.stdout:process_2_[94597]: listed object 0... 2024-04-24T02:00:33.804 INFO:tasks.workunit.client.0.smithi057.stdout:process_2_[94597]: listed object 25... 2024-04-24T02:00:33.804 INFO:tasks.workunit.client.0.smithi057.stdout:process_2_[94597]: saw 50 objects 2024-04-24T02:00:33.804 INFO:tasks.workunit.client.0.smithi057.stdout:process_2_[94597]: shutting down. 2024-04-24T02:00:34.597 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:34.597 INFO:tasks.workunit.client.0.smithi057.stdout:process_3_[94632]: starting. 2024-04-24T02:00:34.597 INFO:tasks.workunit.client.0.smithi057.stdout:process_3_[94632]: creating pool ceph_test_rados_list_parallel.smithi057-94595 2024-04-24T02:00:34.597 INFO:tasks.workunit.client.0.smithi057.stdout:process_3_[94632]: created object 0... 2024-04-24T02:00:34.597 INFO:tasks.workunit.client.0.smithi057.stdout:process_3_[94632]: created object 25... 2024-04-24T02:00:34.597 INFO:tasks.workunit.client.0.smithi057.stdout:process_3_[94632]: created object 49... 2024-04-24T02:00:34.597 INFO:tasks.workunit.client.0.smithi057.stdout:process_3_[94632]: finishing. 2024-04-24T02:00:34.598 INFO:tasks.workunit.client.0.smithi057.stdout:process_3_[94632]: shutting down. 2024-04-24T02:00:34.858 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:34.858 INFO:tasks.workunit.client.0.smithi057.stdout:process_4_[94633]: starting. 2024-04-24T02:00:34.858 INFO:tasks.workunit.client.0.smithi057.stdout:process_4_[94633]: listing objects. 2024-04-24T02:00:34.858 INFO:tasks.workunit.client.0.smithi057.stdout:process_4_[94633]: listed object 0... 2024-04-24T02:00:34.858 INFO:tasks.workunit.client.0.smithi057.stdout:process_4_[94633]: listed object 25... 2024-04-24T02:00:34.858 INFO:tasks.workunit.client.0.smithi057.stdout:process_4_[94633]: saw 43 objects 2024-04-24T02:00:34.858 INFO:tasks.workunit.client.0.smithi057.stdout:process_4_[94633]: shutting down. 2024-04-24T02:00:35.089 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:35.089 INFO:tasks.workunit.client.0.smithi057.stdout:process_5_[94634]: starting. 2024-04-24T02:00:35.089 INFO:tasks.workunit.client.0.smithi057.stdout:process_5_[94634]: removed 25 objects... 2024-04-24T02:00:35.089 INFO:tasks.workunit.client.0.smithi057.stdout:process_5_[94634]: removed half of the objects 2024-04-24T02:00:35.089 INFO:tasks.workunit.client.0.smithi057.stdout:process_5_[94634]: removed 50 objects... 2024-04-24T02:00:35.089 INFO:tasks.workunit.client.0.smithi057.stdout:process_5_[94634]: removed 50 objects 2024-04-24T02:00:35.090 INFO:tasks.workunit.client.0.smithi057.stdout:process_5_[94634]: shutting down. 2024-04-24T02:00:35.639 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:35.639 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:35.639 INFO:tasks.workunit.client.0.smithi057.stdout:process_6_[94683]: starting. 2024-04-24T02:00:35.639 INFO:tasks.workunit.client.0.smithi057.stdout:process_6_[94683]: creating pool ceph_test_rados_list_parallel.smithi057-94595 2024-04-24T02:00:35.640 INFO:tasks.workunit.client.0.smithi057.stdout:process_6_[94683]: created object 0... 2024-04-24T02:00:35.640 INFO:tasks.workunit.client.0.smithi057.stdout:process_6_[94683]: created object 25... 2024-04-24T02:00:35.640 INFO:tasks.workunit.client.0.smithi057.stdout:process_6_[94683]: created object 49... 2024-04-24T02:00:35.640 INFO:tasks.workunit.client.0.smithi057.stdout:process_6_[94683]: finishing. 2024-04-24T02:00:35.640 INFO:tasks.workunit.client.0.smithi057.stdout:process_6_[94683]: shutting down. 2024-04-24T02:00:35.929 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:35.929 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:35.929 INFO:tasks.workunit.client.0.smithi057.stdout:process_7_[94684]: starting. 2024-04-24T02:00:35.929 INFO:tasks.workunit.client.0.smithi057.stdout:process_7_[94684]: listing objects. 2024-04-24T02:00:35.929 INFO:tasks.workunit.client.0.smithi057.stdout:process_7_[94684]: listed object 0... 2024-04-24T02:00:35.929 INFO:tasks.workunit.client.0.smithi057.stdout:process_7_[94684]: listed object 25... 2024-04-24T02:00:35.929 INFO:tasks.workunit.client.0.smithi057.stdout:process_7_[94684]: listed object 50... 2024-04-24T02:00:35.929 INFO:tasks.workunit.client.0.smithi057.stdout:process_7_[94684]: saw 55 objects 2024-04-24T02:00:35.929 INFO:tasks.workunit.client.0.smithi057.stdout:process_7_[94684]: shutting down. 2024-04-24T02:00:36.190 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:36.190 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:36.190 INFO:tasks.workunit.client.0.smithi057.stdout:process_8_[94685]: starting. 2024-04-24T02:00:36.190 INFO:tasks.workunit.client.0.smithi057.stdout:process_8_[94685]: added 25 objects... 2024-04-24T02:00:36.190 INFO:tasks.workunit.client.0.smithi057.stdout:process_8_[94685]: added half of the objects 2024-04-24T02:00:36.190 INFO:tasks.workunit.client.0.smithi057.stdout:process_8_[94685]: added 50 objects... 2024-04-24T02:00:36.190 INFO:tasks.workunit.client.0.smithi057.stdout:process_8_[94685]: added 50 objects 2024-04-24T02:00:36.190 INFO:tasks.workunit.client.0.smithi057.stdout:process_8_[94685]: shutting down. 2024-04-24T02:00:36.751 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:36.751 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:36.752 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:36.752 INFO:tasks.workunit.client.0.smithi057.stdout:process_9_[94734]: starting. 2024-04-24T02:00:36.752 INFO:tasks.workunit.client.0.smithi057.stdout:process_9_[94734]: creating pool ceph_test_rados_list_parallel.smithi057-94595 2024-04-24T02:00:36.752 INFO:tasks.workunit.client.0.smithi057.stdout:process_9_[94734]: created object 0... 2024-04-24T02:00:36.752 INFO:tasks.workunit.client.0.smithi057.stdout:process_9_[94734]: created object 25... 2024-04-24T02:00:36.752 INFO:tasks.workunit.client.0.smithi057.stdout:process_9_[94734]: created object 49... 2024-04-24T02:00:36.752 INFO:tasks.workunit.client.0.smithi057.stdout:process_9_[94734]: finishing. 2024-04-24T02:00:36.752 INFO:tasks.workunit.client.0.smithi057.stdout:process_9_[94734]: shutting down. 2024-04-24T02:00:37.074 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:37.074 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:37.074 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:37.074 INFO:tasks.workunit.client.0.smithi057.stdout:process_10_[94735]: starting. 2024-04-24T02:00:37.074 INFO:tasks.workunit.client.0.smithi057.stdout:process_10_[94735]: listing objects. 2024-04-24T02:00:37.074 INFO:tasks.workunit.client.0.smithi057.stdout:process_10_[94735]: listed object 0... 2024-04-24T02:00:37.075 INFO:tasks.workunit.client.0.smithi057.stdout:process_10_[94735]: listed object 25... 2024-04-24T02:00:37.075 INFO:tasks.workunit.client.0.smithi057.stdout:process_10_[94735]: listed object 50... 2024-04-24T02:00:37.075 INFO:tasks.workunit.client.0.smithi057.stdout:process_10_[94735]: listed object 75... 2024-04-24T02:00:37.075 INFO:tasks.workunit.client.0.smithi057.stdout:process_10_[94735]: saw 98 objects 2024-04-24T02:00:37.075 INFO:tasks.workunit.client.0.smithi057.stdout:process_10_[94735]: shutting down. 2024-04-24T02:00:37.362 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:37.362 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:37.362 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:37.362 INFO:tasks.workunit.client.0.smithi057.stdout:process_13_[94738]: starting. 2024-04-24T02:00:37.362 INFO:tasks.workunit.client.0.smithi057.stdout:process_13_[94738]: removed 25 objects... 2024-04-24T02:00:37.362 INFO:tasks.workunit.client.0.smithi057.stdout:process_13_[94738]: removed half of the objects 2024-04-24T02:00:37.362 INFO:tasks.workunit.client.0.smithi057.stdout:process_13_[94738]: removed 50 objects... 2024-04-24T02:00:37.362 INFO:tasks.workunit.client.0.smithi057.stdout:process_13_[94738]: removed 50 objects 2024-04-24T02:00:37.362 INFO:tasks.workunit.client.0.smithi057.stdout:process_13_[94738]: shutting down. 2024-04-24T02:00:37.422 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:37.422 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:37.422 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:37.423 INFO:tasks.workunit.client.0.smithi057.stdout:process_11_[94736]: starting. 2024-04-24T02:00:37.423 INFO:tasks.workunit.client.0.smithi057.stdout:process_11_[94736]: added 25 objects... 2024-04-24T02:00:37.423 INFO:tasks.workunit.client.0.smithi057.stdout:process_11_[94736]: added half of the objects 2024-04-24T02:00:37.423 INFO:tasks.workunit.client.0.smithi057.stdout:process_11_[94736]: added 50 objects... 2024-04-24T02:00:37.423 INFO:tasks.workunit.client.0.smithi057.stdout:process_11_[94736]: added 50 objects 2024-04-24T02:00:37.423 INFO:tasks.workunit.client.0.smithi057.stdout:process_11_[94736]: shutting down. 2024-04-24T02:00:37.452 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:37.453 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:37.453 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:37.453 INFO:tasks.workunit.client.0.smithi057.stdout:process_12_[94737]: starting. 2024-04-24T02:00:37.453 INFO:tasks.workunit.client.0.smithi057.stdout:process_12_[94737]: added 25 objects... 2024-04-24T02:00:37.453 INFO:tasks.workunit.client.0.smithi057.stdout:process_12_[94737]: added half of the objects 2024-04-24T02:00:37.453 INFO:tasks.workunit.client.0.smithi057.stdout:process_12_[94737]: added 50 objects... 2024-04-24T02:00:37.453 INFO:tasks.workunit.client.0.smithi057.stdout:process_12_[94737]: added 50 objects 2024-04-24T02:00:37.453 INFO:tasks.workunit.client.0.smithi057.stdout:process_12_[94737]: shutting down. 2024-04-24T02:00:38.011 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:38.011 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:38.011 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:38.011 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:38.011 INFO:tasks.workunit.client.0.smithi057.stdout:process_14_[94819]: starting. 2024-04-24T02:00:38.012 INFO:tasks.workunit.client.0.smithi057.stdout:process_14_[94819]: creating pool ceph_test_rados_list_parallel.smithi057-94595 2024-04-24T02:00:38.012 INFO:tasks.workunit.client.0.smithi057.stdout:process_14_[94819]: created object 0... 2024-04-24T02:00:38.012 INFO:tasks.workunit.client.0.smithi057.stdout:process_14_[94819]: created object 25... 2024-04-24T02:00:38.012 INFO:tasks.workunit.client.0.smithi057.stdout:process_14_[94819]: created object 49... 2024-04-24T02:00:38.012 INFO:tasks.workunit.client.0.smithi057.stdout:process_14_[94819]: finishing. 2024-04-24T02:00:38.012 INFO:tasks.workunit.client.0.smithi057.stdout:process_14_[94819]: shutting down. 2024-04-24T02:00:38.296 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:38.297 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:38.297 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:38.297 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:38.297 INFO:tasks.workunit.client.0.smithi057.stdout:process_15_[94820]: starting. 2024-04-24T02:00:38.297 INFO:tasks.workunit.client.0.smithi057.stdout:process_15_[94820]: listing objects. 2024-04-24T02:00:38.297 INFO:tasks.workunit.client.0.smithi057.stdout:process_15_[94820]: listed object 0... 2024-04-24T02:00:38.297 INFO:tasks.workunit.client.0.smithi057.stdout:process_15_[94820]: listed object 25... 2024-04-24T02:00:38.297 INFO:tasks.workunit.client.0.smithi057.stdout:process_15_[94820]: listed object 50... 2024-04-24T02:00:38.297 INFO:tasks.workunit.client.0.smithi057.stdout:process_15_[94820]: listed object 75... 2024-04-24T02:00:38.297 INFO:tasks.workunit.client.0.smithi057.stdout:process_15_[94820]: listed object 100... 2024-04-24T02:00:38.297 INFO:tasks.workunit.client.0.smithi057.stdout:process_15_[94820]: listed object 125... 2024-04-24T02:00:38.297 INFO:tasks.workunit.client.0.smithi057.stdout:process_15_[94820]: saw 150 objects 2024-04-24T02:00:38.297 INFO:tasks.workunit.client.0.smithi057.stdout:process_15_[94820]: shutting down. 2024-04-24T02:00:38.572 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:38.572 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:38.572 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:38.572 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:38.572 INFO:tasks.workunit.client.0.smithi057.stdout:process_16_[94821]: starting. 2024-04-24T02:00:38.573 INFO:tasks.workunit.client.0.smithi057.stdout:process_16_[94821]: added 25 objects... 2024-04-24T02:00:38.573 INFO:tasks.workunit.client.0.smithi057.stdout:process_16_[94821]: added half of the objects 2024-04-24T02:00:38.573 INFO:tasks.workunit.client.0.smithi057.stdout:process_16_[94821]: added 50 objects... 2024-04-24T02:00:38.573 INFO:tasks.workunit.client.0.smithi057.stdout:process_16_[94821]: added 50 objects 2024-04-24T02:00:38.573 INFO:tasks.workunit.client.0.smithi057.stdout:process_16_[94821]: shutting down. 2024-04-24T02:00:38.724 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:38.724 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:38.724 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:38.724 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:38.724 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:38.724 INFO:tasks.workunit.client.0.smithi057.stdout:******* SUCCESS ********** 2024-04-24T02:00:38.725 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-24T02:00:38.725 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T02:00:38.725 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_rados_open_pools_parallel 2024-04-24T02:00:41.661 INFO:tasks.workunit.client.0.smithi057.stdout:process_1_[94887]: starting. 2024-04-24T02:00:41.662 INFO:tasks.workunit.client.0.smithi057.stdout:process_1_[94887]: creating pool ceph_test_rados_open_pools_parallel.smithi057-94886 2024-04-24T02:00:41.662 INFO:tasks.workunit.client.0.smithi057.stdout:process_1_[94887]: created object 0... 2024-04-24T02:00:41.662 INFO:tasks.workunit.client.0.smithi057.stdout:process_1_[94887]: created object 25... 2024-04-24T02:00:41.662 INFO:tasks.workunit.client.0.smithi057.stdout:process_1_[94887]: created object 49... 2024-04-24T02:00:41.662 INFO:tasks.workunit.client.0.smithi057.stdout:process_1_[94887]: finishing. 2024-04-24T02:00:41.662 INFO:tasks.workunit.client.0.smithi057.stdout:process_1_[94887]: shutting down. 2024-04-24T02:00:41.765 INFO:tasks.workunit.client.0.smithi057.stdout:process_2_[94888]: starting. 2024-04-24T02:00:41.765 INFO:tasks.workunit.client.0.smithi057.stdout:process_2_[94888]: rados_pool_create. 2024-04-24T02:00:41.765 INFO:tasks.workunit.client.0.smithi057.stdout:process_2_[94888]: rados_ioctx_create. 2024-04-24T02:00:41.765 INFO:tasks.workunit.client.0.smithi057.stdout:process_2_[94888]: shutting down. 2024-04-24T02:00:44.524 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:44.524 INFO:tasks.workunit.client.0.smithi057.stdout:process_3_[94923]: starting. 2024-04-24T02:00:44.524 INFO:tasks.workunit.client.0.smithi057.stdout:process_3_[94923]: creating pool ceph_test_rados_open_pools_parallel.smithi057-94886 2024-04-24T02:00:44.524 INFO:tasks.workunit.client.0.smithi057.stdout:process_3_[94923]: created object 0... 2024-04-24T02:00:44.524 INFO:tasks.workunit.client.0.smithi057.stdout:process_3_[94923]: created object 25... 2024-04-24T02:00:44.524 INFO:tasks.workunit.client.0.smithi057.stdout:process_3_[94923]: created object 49... 2024-04-24T02:00:44.524 INFO:tasks.workunit.client.0.smithi057.stdout:process_3_[94923]: finishing. 2024-04-24T02:00:44.525 INFO:tasks.workunit.client.0.smithi057.stdout:process_3_[94923]: shutting down. 2024-04-24T02:00:44.779 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:44.780 INFO:tasks.workunit.client.0.smithi057.stdout:process_4_[94924]: starting. 2024-04-24T02:00:44.780 INFO:tasks.workunit.client.0.smithi057.stdout:process_4_[94924]: rados_pool_create. 2024-04-24T02:00:44.780 INFO:tasks.workunit.client.0.smithi057.stdout:process_4_[94924]: rados_ioctx_create. 2024-04-24T02:00:44.780 INFO:tasks.workunit.client.0.smithi057.stdout:process_4_[94924]: shutting down. 2024-04-24T02:00:44.781 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:44.781 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:44.781 INFO:tasks.workunit.client.0.smithi057.stdout:******* SUCCESS ********** 2024-04-24T02:00:44.782 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-04-24T02:00:44.782 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T02:00:44.783 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_rados_delete_pools_parallel 2024-04-24T02:00:47.699 INFO:tasks.workunit.client.0.smithi057.stdout:process_1_[94960]: starting. 2024-04-24T02:00:47.700 INFO:tasks.workunit.client.0.smithi057.stdout:process_1_[94960]: creating pool ceph_test_rados_delete_pools_parallel.smithi057-94959 2024-04-24T02:00:47.700 INFO:tasks.workunit.client.0.smithi057.stdout:process_1_[94960]: created object 0... 2024-04-24T02:00:47.700 INFO:tasks.workunit.client.0.smithi057.stdout:process_1_[94960]: created object 25... 2024-04-24T02:00:47.700 INFO:tasks.workunit.client.0.smithi057.stdout:process_1_[94960]: created object 49... 2024-04-24T02:00:47.700 INFO:tasks.workunit.client.0.smithi057.stdout:process_1_[94960]: finishing. 2024-04-24T02:00:47.700 INFO:tasks.workunit.client.0.smithi057.stdout:process_1_[94960]: shutting down. 2024-04-24T02:00:47.808 INFO:tasks.workunit.client.0.smithi057.stdout:process_2_[94961]: starting. 2024-04-24T02:00:47.808 INFO:tasks.workunit.client.0.smithi057.stdout:process_2_[94961]: deleting pool ceph_test_rados_delete_pools_parallel.smithi057-94959 2024-04-24T02:00:47.808 INFO:tasks.workunit.client.0.smithi057.stdout:process_2_[94961]: shutting down. 2024-04-24T02:00:50.728 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:50.728 INFO:tasks.workunit.client.0.smithi057.stdout:process_3_[94996]: starting. 2024-04-24T02:00:50.728 INFO:tasks.workunit.client.0.smithi057.stdout:process_3_[94996]: creating pool ceph_test_rados_delete_pools_parallel.smithi057-94959 2024-04-24T02:00:50.728 INFO:tasks.workunit.client.0.smithi057.stdout:process_3_[94996]: created object 0... 2024-04-24T02:00:50.728 INFO:tasks.workunit.client.0.smithi057.stdout:process_3_[94996]: created object 25... 2024-04-24T02:00:50.728 INFO:tasks.workunit.client.0.smithi057.stdout:process_3_[94996]: created object 49... 2024-04-24T02:00:50.728 INFO:tasks.workunit.client.0.smithi057.stdout:process_3_[94996]: finishing. 2024-04-24T02:00:50.728 INFO:tasks.workunit.client.0.smithi057.stdout:process_3_[94996]: shutting down. 2024-04-24T02:00:50.927 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:50.927 INFO:tasks.workunit.client.0.smithi057.stdout:process_5_[94998]: starting. 2024-04-24T02:00:50.927 INFO:tasks.workunit.client.0.smithi057.stdout:process_5_[94998]: listing objects. 2024-04-24T02:00:50.927 INFO:tasks.workunit.client.0.smithi057.stdout:process_5_[94998]: listed object 0... 2024-04-24T02:00:50.928 INFO:tasks.workunit.client.0.smithi057.stdout:process_5_[94998]: listed object 25... 2024-04-24T02:00:50.928 INFO:tasks.workunit.client.0.smithi057.stdout:process_5_[94998]: saw 50 objects 2024-04-24T02:00:50.928 INFO:tasks.workunit.client.0.smithi057.stdout:process_5_[94998]: shutting down. 2024-04-24T02:00:51.841 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:51.842 INFO:tasks.workunit.client.0.smithi057.stdout:process_4_[94997]: starting. 2024-04-24T02:00:51.842 INFO:tasks.workunit.client.0.smithi057.stdout:process_4_[94997]: deleting pool ceph_test_rados_delete_pools_parallel.smithi057-94959 2024-04-24T02:00:51.842 INFO:tasks.workunit.client.0.smithi057.stdout:process_4_[94997]: shutting down. 2024-04-24T02:00:51.843 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:51.843 INFO:tasks.workunit.client.0.smithi057.stdout:******************************* 2024-04-24T02:00:51.843 INFO:tasks.workunit.client.0.smithi057.stdout:******* SUCCESS ********** 2024-04-24T02:00:51.844 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-24T02:00:51.844 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T02:00:51.844 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 1 -eq 1 ']' 2024-04-24T02:00:51.845 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' cls = ec_io ']' 2024-04-24T02:00:51.845 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' cls = ec_list ']' 2024-04-24T02:00:51.845 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_neorados_cls 2024-04-24T02:00:51.866 INFO:tasks.workunit.client.0.smithi057.stdout:Running main() from gmock_main.cc 2024-04-24T02:00:51.866 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 2 tests from 1 test suite. 2024-04-24T02:00:51.866 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T02:00:51.866 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 2 tests from NeoRadosCls 2024-04-24T02:00:51.866 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosCls.DNE 2024-04-24T02:00:54.856 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosCls.DNE (2989 ms) 2024-04-24T02:00:54.856 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosCls.RemoteReads 2024-04-24T02:00:55.873 INFO:tasks.workunit.client.0.smithi057.stderr:Not supported by crimson yet. Skipped 2024-04-24T02:00:56.877 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosCls.RemoteReads (2022 ms) 2024-04-24T02:00:56.877 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 2 tests from NeoRadosCls (5011 ms total) 2024-04-24T02:00:56.877 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T02:00:56.877 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T02:00:56.877 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 2 tests from 1 test suite ran. (5011 ms total) 2024-04-24T02:00:56.877 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 2 tests. 2024-04-24T02:00:56.879 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-24T02:00:56.879 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T02:00:56.879 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 1 -eq 1 ']' 2024-04-24T02:00:56.879 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' cmd = ec_io ']' 2024-04-24T02:00:56.879 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' cmd = ec_list ']' 2024-04-24T02:00:56.879 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_neorados_cmd 2024-04-24T02:00:56.899 INFO:tasks.workunit.client.0.smithi057.stdout:Running main() from gmock_main.cc 2024-04-24T02:00:56.899 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 3 tests from 1 test suite. 2024-04-24T02:00:56.899 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T02:00:56.900 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 3 tests from NeoRadosCmd 2024-04-24T02:00:56.900 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosCmd.MonDescribe 2024-04-24T02:00:58.892 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosCmd.MonDescribe (1993 ms) 2024-04-24T02:00:58.893 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosCmd.OSDCmd 2024-04-24T02:01:00.904 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosCmd.OSDCmd (2011 ms) 2024-04-24T02:01:00.904 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosCmd.PGCmd 2024-04-24T02:01:03.655 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosCmd.PGCmd (2751 ms) 2024-04-24T02:01:03.655 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 3 tests from NeoRadosCmd (6755 ms total) 2024-04-24T02:01:03.656 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T02:01:03.656 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T02:01:03.656 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 3 tests from 1 test suite ran. (6755 ms total) 2024-04-24T02:01:03.656 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 3 tests. 2024-04-24T02:01:03.657 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-24T02:01:03.658 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T02:01:03.658 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 1 -eq 1 ']' 2024-04-24T02:01:03.658 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' handler_error = ec_io ']' 2024-04-24T02:01:03.658 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' handler_error = ec_list ']' 2024-04-24T02:01:03.658 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_neorados_handler_error 2024-04-24T02:01:03.675 INFO:tasks.workunit.client.0.smithi057.stdout:Running main() from gmock_main.cc 2024-04-24T02:01:03.675 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 1 test from 1 test suite. 2024-04-24T02:01:03.675 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T02:01:03.675 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 1 test from neocls_handler_error 2024-04-24T02:01:03.675 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] neocls_handler_error.test_handler_error 2024-04-24T02:01:06.668 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] neocls_handler_error.test_handler_error (2993 ms) 2024-04-24T02:01:06.668 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 1 test from neocls_handler_error (2994 ms total) 2024-04-24T02:01:06.669 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T02:01:06.669 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T02:01:06.669 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 1 test from 1 test suite ran. (2994 ms total) 2024-04-24T02:01:06.669 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 1 test. 2024-04-24T02:01:06.670 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-24T02:01:06.670 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T02:01:06.670 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 1 -eq 1 ']' 2024-04-24T02:01:06.670 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' io = ec_io ']' 2024-04-24T02:01:06.671 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' io = ec_list ']' 2024-04-24T02:01:06.671 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_neorados_io 2024-04-24T02:01:06.691 INFO:tasks.workunit.client.0.smithi057.stdout:Running main() from gmock_main.cc 2024-04-24T02:01:06.691 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 14 tests from 1 test suite. 2024-04-24T02:01:06.692 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T02:01:06.692 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 14 tests from NeoRadosIo 2024-04-24T02:01:06.692 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosIo.Limits 2024-04-24T02:01:07.678 INFO:tasks.workunit.client.0.smithi057.stderr:Not supported by crimson yet. Skipped 2024-04-24T02:01:08.660 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosIo.Limits (1968 ms) 2024-04-24T02:01:08.660 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosIo.SimpleWrite 2024-04-24T02:01:11.713 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosIo.SimpleWrite (3053 ms) 2024-04-24T02:01:11.713 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosIo.ReadOp 2024-04-24T02:01:14.727 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosIo.ReadOp (3014 ms) 2024-04-24T02:01:14.727 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosIo.SparseRead 2024-04-24T02:01:17.759 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosIo.SparseRead (3032 ms) 2024-04-24T02:01:17.759 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosIo.RoundTrip 2024-04-24T02:01:20.770 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosIo.RoundTrip (3011 ms) 2024-04-24T02:01:20.770 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosIo.ReadIntoBuufferlist 2024-04-24T02:01:23.794 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosIo.ReadIntoBuufferlist (3024 ms) 2024-04-24T02:01:23.794 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2024-04-24T02:01:26.815 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosIo.OverlappingWriteRoundTrip (3022 ms) 2024-04-24T02:01:26.816 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosIo.WriteFullRoundTrip 2024-04-24T02:01:29.825 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosIo.WriteFullRoundTrip (3009 ms) 2024-04-24T02:01:29.825 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosIo.AppendRoundTrip 2024-04-24T02:01:32.839 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosIo.AppendRoundTrip (3014 ms) 2024-04-24T02:01:32.839 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosIo.Trunc 2024-04-24T02:01:35.862 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosIo.Trunc (3024 ms) 2024-04-24T02:01:35.863 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosIo.Remove 2024-04-24T02:01:38.666 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosIo.Remove (2804 ms) 2024-04-24T02:01:38.667 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosIo.XattrsRoundTrip 2024-04-24T02:01:41.898 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosIo.XattrsRoundTrip (3232 ms) 2024-04-24T02:01:41.899 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosIo.RmXattr 2024-04-24T02:01:44.906 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosIo.RmXattr (3008 ms) 2024-04-24T02:01:44.907 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosIo.GetXattrs 2024-04-24T02:01:47.937 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosIo.GetXattrs (3031 ms) 2024-04-24T02:01:47.937 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 14 tests from NeoRadosIo (41246 ms total) 2024-04-24T02:01:47.938 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T02:01:47.938 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T02:01:47.938 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 14 tests from 1 test suite ran. (41246 ms total) 2024-04-24T02:01:47.938 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 14 tests. 2024-04-24T02:01:47.941 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-24T02:01:47.941 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T02:01:47.941 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 1 -eq 1 ']' 2024-04-24T02:01:47.941 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' ec_io = ec_io ']' 2024-04-24T02:01:47.941 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'Skipping EC with Crimson' 2024-04-24T02:01:47.941 INFO:tasks.workunit.client.0.smithi057.stdout:Skipping EC with Crimson 2024-04-24T02:01:47.942 INFO:tasks.workunit.client.0.smithi057.stderr:+ continue 2024-04-24T02:01:47.942 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-24T02:01:47.942 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T02:01:47.942 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 1 -eq 1 ']' 2024-04-24T02:01:47.942 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' list = ec_io ']' 2024-04-24T02:01:47.942 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' list = ec_list ']' 2024-04-24T02:01:47.942 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_neorados_list 2024-04-24T02:01:47.964 INFO:tasks.workunit.client.0.smithi057.stdout:Running main() from gmock_main.cc 2024-04-24T02:01:47.964 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 3 tests from 1 test suite. 2024-04-24T02:01:47.964 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T02:01:47.964 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 3 tests from NeoradosList 2024-04-24T02:01:47.964 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoradosList.ListObjects 2024-04-24T02:01:50.674 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoradosList.ListObjects (2709 ms) 2024-04-24T02:01:50.674 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoradosList.ListObjectsNS 2024-04-24T02:01:53.703 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoradosList.ListObjectsNS (3030 ms) 2024-04-24T02:01:53.704 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoradosList.ListObjectsMany 2024-04-24T02:02:01.718 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoradosList.ListObjectsMany (8014 ms) 2024-04-24T02:02:01.718 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 3 tests from NeoradosList (13753 ms total) 2024-04-24T02:02:01.718 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T02:02:01.718 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T02:02:01.719 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 3 tests from 1 test suite ran. (13753 ms total) 2024-04-24T02:02:01.719 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 3 tests. 2024-04-24T02:02:01.720 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-24T02:02:01.721 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T02:02:01.721 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 1 -eq 1 ']' 2024-04-24T02:02:01.721 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' ec_list = ec_io ']' 2024-04-24T02:02:01.721 INFO:tasks.workunit.client.0.smithi057.stdout:Skipping EC with Crimson 2024-04-24T02:02:01.722 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' ec_list = ec_list ']' 2024-04-24T02:02:01.722 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo 'Skipping EC with Crimson' 2024-04-24T02:02:01.722 INFO:tasks.workunit.client.0.smithi057.stderr:+ continue 2024-04-24T02:02:01.722 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-24T02:02:01.722 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T02:02:01.723 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 1 -eq 1 ']' 2024-04-24T02:02:01.723 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' misc = ec_io ']' 2024-04-24T02:02:01.723 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' misc = ec_list ']' 2024-04-24T02:02:01.723 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_neorados_misc 2024-04-24T02:02:01.738 INFO:tasks.workunit.client.0.smithi057.stdout:Running main() from gmock_main.cc 2024-04-24T02:02:01.738 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 12 tests from 1 test suite. 2024-04-24T02:02:01.738 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T02:02:01.738 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 12 tests from NeoRadosMisc 2024-04-24T02:02:01.738 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosMisc.Version 2024-04-24T02:02:03.733 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosMisc.Version (1996 ms) 2024-04-24T02:02:03.733 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosMisc.WaitOSDMap 2024-04-24T02:02:05.751 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosMisc.WaitOSDMap (2017 ms) 2024-04-24T02:02:05.751 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosMisc.LongName 2024-04-24T02:02:08.670 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosMisc.LongName (2919 ms) 2024-04-24T02:02:08.670 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosMisc.LongLocator 2024-04-24T02:02:09.672 INFO:tasks.workunit.client.0.smithi057.stderr:Not supported by crimson yet. Skipped 2024-04-24T02:02:10.680 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosMisc.LongLocator (2010 ms) 2024-04-24T02:02:10.680 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosMisc.LongNamespace 2024-04-24T02:02:13.712 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosMisc.LongNamespace (3032 ms) 2024-04-24T02:02:13.712 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosMisc.LongAttrName 2024-04-24T02:02:16.745 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosMisc.LongAttrName (3033 ms) 2024-04-24T02:02:16.745 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosMisc.Exec 2024-04-24T02:02:19.762 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosMisc.Exec (3017 ms) 2024-04-24T02:02:19.762 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosMisc.Operate1 2024-04-24T02:02:22.800 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosMisc.Operate1 (3039 ms) 2024-04-24T02:02:22.801 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosMisc.Operate2 2024-04-24T02:02:25.827 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosMisc.Operate2 (3026 ms) 2024-04-24T02:02:25.827 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosMisc.BigObject 2024-04-24T02:02:28.675 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosMisc.BigObject (2848 ms) 2024-04-24T02:02:28.675 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosMisc.BigAttr 2024-04-24T02:02:30.685 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosMisc.BigAttr (2010 ms) 2024-04-24T02:02:30.685 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosMisc.WriteSame 2024-04-24T02:02:31.702 INFO:tasks.workunit.client.0.smithi057.stderr:Not supported by crimson yet. Skipped 2024-04-24T02:02:32.707 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosMisc.WriteSame (2022 ms) 2024-04-24T02:02:32.707 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 12 tests from NeoRadosMisc (30969 ms total) 2024-04-24T02:02:32.707 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T02:02:32.707 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T02:02:32.707 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 12 tests from 1 test suite ran. (30969 ms total) 2024-04-24T02:02:32.707 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 12 tests. 2024-04-24T02:02:32.711 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-24T02:02:32.711 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T02:02:32.711 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 1 -eq 1 ']' 2024-04-24T02:02:32.712 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' pool = ec_io ']' 2024-04-24T02:02:32.712 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' pool = ec_list ']' 2024-04-24T02:02:32.712 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_neorados_pool 2024-04-24T02:02:32.741 INFO:tasks.workunit.client.0.smithi057.stdout:Running main() from gmock_main.cc 2024-04-24T02:02:32.741 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 6 tests from 1 test suite. 2024-04-24T02:02:32.741 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T02:02:32.742 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 6 tests from NeoRadosPools 2024-04-24T02:02:32.742 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosPools.PoolList 2024-04-24T02:02:34.720 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosPools.PoolList (1978 ms) 2024-04-24T02:02:34.720 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosPools.PoolLookup 2024-04-24T02:02:36.736 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosPools.PoolLookup (2016 ms) 2024-04-24T02:02:36.736 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosPools.PoolLookupOtherInstance 2024-04-24T02:02:38.678 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosPools.PoolLookupOtherInstance (1942 ms) 2024-04-24T02:02:38.678 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosPools.PoolDelete 2024-04-24T02:02:42.686 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosPools.PoolDelete (4008 ms) 2024-04-24T02:02:42.686 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosPools.PoolCreateDelete 2024-04-24T02:02:44.718 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosPools.PoolCreateDelete (2033 ms) 2024-04-24T02:02:44.719 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2024-04-24T02:02:46.729 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosPools.PoolCreateWithCrushRule (2010 ms) 2024-04-24T02:02:46.729 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 6 tests from NeoRadosPools (13987 ms total) 2024-04-24T02:02:46.729 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T02:02:46.729 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T02:02:46.729 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 6 tests from 1 test suite ran. (13988 ms total) 2024-04-24T02:02:46.729 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 6 tests. 2024-04-24T02:02:46.732 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-24T02:02:46.733 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T02:02:46.733 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 1 -eq 1 ']' 2024-04-24T02:02:46.733 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' read_operations = ec_io ']' 2024-04-24T02:02:46.733 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' read_operations = ec_list ']' 2024-04-24T02:02:46.733 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_neorados_read_operations 2024-04-24T02:02:46.757 INFO:tasks.workunit.client.0.smithi057.stdout:Running main() from gmock_main.cc 2024-04-24T02:02:46.757 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 14 tests from 1 test suite. 2024-04-24T02:02:46.757 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T02:02:46.757 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 14 tests from NeoRadosReadOps 2024-04-24T02:02:46.757 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosReadOps.SetOpFlags 2024-04-24T02:02:49.747 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosReadOps.SetOpFlags (2989 ms) 2024-04-24T02:02:49.747 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosReadOps.AssertExists 2024-04-24T02:02:52.807 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosReadOps.AssertExists (3060 ms) 2024-04-24T02:02:52.807 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosReadOps.AssertVersion 2024-04-24T02:02:55.846 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosReadOps.AssertVersion (3039 ms) 2024-04-24T02:02:55.846 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosReadOps.CmpXattr 2024-04-24T02:02:58.682 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosReadOps.CmpXattr (2837 ms) 2024-04-24T02:02:58.683 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosReadOps.Read 2024-04-24T02:03:01.875 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosReadOps.Read (3192 ms) 2024-04-24T02:03:01.875 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosReadOps.Checksum 2024-04-24T02:03:04.886 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosReadOps.Checksum (3011 ms) 2024-04-24T02:03:04.886 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosReadOps.RWOrderedRead 2024-04-24T02:03:07.913 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosReadOps.RWOrderedRead (3027 ms) 2024-04-24T02:03:07.913 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosReadOps.ShortRead 2024-04-24T02:03:10.917 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosReadOps.ShortRead (3004 ms) 2024-04-24T02:03:10.917 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosReadOps.Exec 2024-04-24T02:03:13.946 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosReadOps.Exec (3029 ms) 2024-04-24T02:03:13.946 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosReadOps.Stat 2024-04-24T02:03:16.963 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosReadOps.Stat (3018 ms) 2024-04-24T02:03:16.963 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosReadOps.Omap 2024-04-24T02:03:19.690 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosReadOps.Omap (2726 ms) 2024-04-24T02:03:19.690 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosReadOps.OmapNuls 2024-04-24T02:03:22.711 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosReadOps.OmapNuls (3022 ms) 2024-04-24T02:03:22.712 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosReadOps.GetXattrs 2024-04-24T02:03:25.726 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosReadOps.GetXattrs (3014 ms) 2024-04-24T02:03:25.726 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosReadOps.CmpExt 2024-04-24T02:03:28.689 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosReadOps.CmpExt (2964 ms) 2024-04-24T02:03:28.689 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 14 tests from NeoRadosReadOps (41932 ms total) 2024-04-24T02:03:28.690 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T02:03:28.690 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T02:03:28.690 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 14 tests from 1 test suite ran. (41933 ms total) 2024-04-24T02:03:28.690 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 14 tests. 2024-04-24T02:03:28.693 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-24T02:03:28.693 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T02:03:28.693 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 1 -eq 1 ']' 2024-04-24T02:03:28.693 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' snapshots = ec_io ']' 2024-04-24T02:03:28.693 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' snapshots = ec_list ']' 2024-04-24T02:03:28.693 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_neorados_snapshots 2024-04-24T02:03:28.716 INFO:tasks.workunit.client.0.smithi057.stdout:Running main() from gmock_main.cc 2024-04-24T02:03:28.716 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 11 tests from 2 test suites. 2024-04-24T02:03:28.716 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T02:03:28.716 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 5 tests from NeoRadosSnapshots 2024-04-24T02:03:28.716 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosSnapshots.SnapList 2024-04-24T02:03:33.765 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosSnapshots.SnapList (5050 ms) 2024-04-24T02:03:33.765 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosSnapshots.SnapRemove 2024-04-24T02:03:38.691 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosSnapshots.SnapRemove (4926 ms) 2024-04-24T02:03:38.692 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosSnapshots.Rollback 2024-04-24T02:03:42.823 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosSnapshots.Rollback (4131 ms) 2024-04-24T02:03:42.823 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosSnapshots.SnapGetName 2024-04-24T02:03:47.855 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosSnapshots.SnapGetName (5032 ms) 2024-04-24T02:03:47.855 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosSnapshots.SnapCreateRemove 2024-04-24T02:03:54.876 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosSnapshots.SnapCreateRemove (7021 ms) 2024-04-24T02:03:54.876 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 5 tests from NeoRadosSnapshots (26160 ms total) 2024-04-24T02:03:54.876 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T02:03:54.876 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 6 tests from NeoRadosSelfManagedSnaps 2024-04-24T02:03:54.877 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Snap 2024-04-24T02:03:59.915 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosSelfManagedSnaps.Snap (5039 ms) 2024-04-24T02:03:59.915 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Rollback 2024-04-24T02:04:00.916 INFO:tasks.workunit.client.0.smithi057.stderr:Not supported by crimson yet. Skipped 2024-04-24T02:04:01.934 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosSelfManagedSnaps.Rollback (2020 ms) 2024-04-24T02:04:01.935 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2024-04-24T02:04:02.939 INFO:tasks.workunit.client.0.smithi057.stderr:Not supported by crimson yet. Skipped 2024-04-24T02:04:03.950 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (2016 ms) 2024-04-24T02:04:03.951 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2024-04-24T02:04:09.703 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosSelfManagedSnaps.Bug11677 (5752 ms) 2024-04-24T02:04:09.703 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2024-04-24T02:04:13.721 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosSelfManagedSnaps.OrderSnap (4018 ms) 2024-04-24T02:04:13.721 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2024-04-24T02:04:16.749 INFO:tasks.workunit.client.0.smithi057.stdout:Deleting snap 3 in pool ReusePurgedSnapsmithi057-95920-11. 2024-04-24T02:04:17.748 INFO:tasks.workunit.client.0.smithi057.stdout:Waiting for snaps to purge. 2024-04-24T02:04:32.781 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (19060 ms) 2024-04-24T02:04:32.781 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 6 tests from NeoRadosSelfManagedSnaps (37905 ms total) 2024-04-24T02:04:32.781 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T02:04:32.781 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T02:04:32.781 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 11 tests from 2 test suites ran. (64065 ms total) 2024-04-24T02:04:32.781 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 11 tests. 2024-04-24T02:04:32.785 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-24T02:04:32.785 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T02:04:32.785 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 1 -eq 1 ']' 2024-04-24T02:04:32.785 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' watch_notify = ec_io ']' 2024-04-24T02:04:32.785 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' watch_notify = ec_list ']' 2024-04-24T02:04:32.785 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_neorados_watch_notify 2024-04-24T02:04:32.806 INFO:tasks.workunit.client.0.smithi057.stdout:Running main() from gmock_main.cc 2024-04-24T02:04:32.806 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 2 tests from 1 test suite. 2024-04-24T02:04:32.806 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T02:04:32.806 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 2 tests from NeoRadosWatchNotify 2024-04-24T02:04:32.807 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosWatchNotify.WatchNotify 2024-04-24T02:04:35.251 INFO:tasks.workunit.client.0.smithi057.stdout:handle_notify cookie 37545648 notify_id 2808908611589 notifier_gid 15954 2024-04-24T02:04:35.807 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosWatchNotify.WatchNotify (3002 ms) 2024-04-24T02:04:35.808 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2024-04-24T02:04:38.343 INFO:tasks.workunit.client.0.smithi057.stdout:Trying... 2024-04-24T02:04:38.346 INFO:tasks.workunit.client.0.smithi057.stdout:handle_notify cookie 50145616 notify_id 2821793513477 notifier_gid 15957 2024-04-24T02:04:38.346 INFO:tasks.workunit.client.0.smithi057.stdout:Waiting for 3.000000000s 2024-04-24T02:04:39.345 INFO:tasks.workunit.client.0.smithi057.stdout:Timed out. 2024-04-24T02:04:39.356 INFO:tasks.workunit.client.0.smithi057.stdout:Flushing... 2024-04-24T02:04:39.356 INFO:tasks.workunit.client.0.smithi057.stdout:Flushed... 2024-04-24T02:04:42.834 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (7027 ms) 2024-04-24T02:04:42.835 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 2 tests from NeoRadosWatchNotify (10029 ms total) 2024-04-24T02:04:42.835 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T02:04:42.835 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T02:04:42.835 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 2 tests from 1 test suite ran. (10029 ms total) 2024-04-24T02:04:42.835 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 2 tests. 2024-04-24T02:04:42.837 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-04-24T02:04:42.837 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T02:04:42.837 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 1 -eq 1 ']' 2024-04-24T02:04:42.837 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' write_operations = ec_io ']' 2024-04-24T02:04:42.837 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' write_operations = ec_list ']' 2024-04-24T02:04:42.837 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph_test_neorados_write_operations 2024-04-24T02:04:42.863 INFO:tasks.workunit.client.0.smithi057.stdout:Running main() from gmock_main.cc 2024-04-24T02:04:42.863 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] Running 7 tests from 1 test suite. 2024-04-24T02:04:42.863 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment set-up. 2024-04-24T02:04:42.863 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 7 tests from NeoRadosWriteOps 2024-04-24T02:04:42.863 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosWriteOps.AssertExists 2024-04-24T02:04:45.867 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosWriteOps.AssertExists (3004 ms) 2024-04-24T02:04:45.867 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosWriteOps.AssertVersion 2024-04-24T02:04:48.709 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosWriteOps.AssertVersion (2842 ms) 2024-04-24T02:04:48.709 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosWriteOps.Xattrs 2024-04-24T02:04:51.892 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosWriteOps.Xattrs (3183 ms) 2024-04-24T02:04:51.892 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosWriteOps.Write 2024-04-24T02:04:54.907 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosWriteOps.Write (3015 ms) 2024-04-24T02:04:54.907 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosWriteOps.Exec 2024-04-24T02:04:57.937 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosWriteOps.Exec (3030 ms) 2024-04-24T02:04:57.937 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosWriteOps.WriteSame 2024-04-24T02:05:00.950 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosWriteOps.WriteSame (3013 ms) 2024-04-24T02:05:00.950 INFO:tasks.workunit.client.0.smithi057.stdout:[ RUN ] NeoRadosWriteOps.CmpExt 2024-04-24T02:05:11.716 INFO:tasks.workunit.client.0.smithi057.stdout:[ OK ] NeoRadosWriteOps.CmpExt (10765 ms) 2024-04-24T02:05:11.716 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] 7 tests from NeoRadosWriteOps (28852 ms total) 2024-04-24T02:05:11.716 INFO:tasks.workunit.client.0.smithi057.stdout: 2024-04-24T02:05:11.716 INFO:tasks.workunit.client.0.smithi057.stdout:[----------] Global test environment tear-down 2024-04-24T02:05:11.716 INFO:tasks.workunit.client.0.smithi057.stdout:[==========] 7 tests from 1 test suite ran. (28853 ms total) 2024-04-24T02:05:11.716 INFO:tasks.workunit.client.0.smithi057.stdout:[ PASSED ] 7 tests. 2024-04-24T02:05:11.718 INFO:tasks.workunit.client.0.smithi057.stderr:+ ret=0 2024-04-24T02:05:11.718 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -eq 1 ']' 2024-04-24T02:05:11.719 INFO:tasks.workunit.client.0.smithi057.stderr:+ exit 0 2024-04-24T02:05:11.719 INFO:tasks.workunit.client.0.smithi057.stderr:+ cleanup 2024-04-24T02:05:11.719 INFO:tasks.workunit.client.0.smithi057.stderr:+ pkill -P 30301 2024-04-24T02:05:11.735 INFO:tasks.workunit.client.0.smithi057.stderr:+ true 2024-04-24T02:05:11.736 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-24T02:05:11.736 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-24T02:05:11.805 INFO:tasks.workunit:Running workunits matching rados/test_pool_quota.sh on client.0... 2024-04-24T02:05:11.806 INFO:tasks.workunit:Running workunit rados/test_pool_quota.sh... 2024-04-24T02:05:11.806 DEBUG:teuthology.orchestra.run.smithi057:workunit test rados/test_pool_quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=424d8c4389b684b0a4d72510e1b4d398d8e6c8f4 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 CRIMSON_COMPAT=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_pool_quota.sh 2024-04-24T02:05:11.865 INFO:tasks.workunit.client.0.smithi057.stderr:++ uuidgen 2024-04-24T02:05:11.868 INFO:tasks.workunit.client.0.smithi057.stderr:+ p=319496fe-d53f-40fe-a120-83451e8717ac 2024-04-24T02:05:11.868 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph osd pool create 319496fe-d53f-40fe-a120-83451e8717ac 12 2024-04-24T02:05:11.963 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.956+0000 7f6bba7ff640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:11.964 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.964+0000 7f6bb959d640 1 Processor -- start 2024-04-24T02:05:11.964 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.964+0000 7f6bb959d640 1 -- start start 2024-04-24T02:05:11.967 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.966+0000 7f6bb959d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6bb409be10 0x7f6bb4136420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:11.967 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.966+0000 7f6bb959d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bb409c990 con 0x7f6bb409b2f0 2024-04-24T02:05:11.967 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.966+0000 7f6bb959d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f6bb409c640 con 0x7f6bb409be10 2024-04-24T02:05:11.967 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.966+0000 7f6bb37fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6bb409be10 0x7f6bb4136420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:11.967 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.966+0000 7f6bb3fff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6bb409b2f0 0x7f6bb409b700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43540/0 (socket says 172.21.15.57:43540) 2024-04-24T02:05:11.967 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.966+0000 7f6bb3fff640 1 -- 172.21.15.57:0/1952531966 learned_addr learned my addr 172.21.15.57:0/1952531966 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T02:05:11.967 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.966+0000 7f6bb37fe640 1 -- 172.21.15.57:0/1952531966 >> v1:172.21.15.57:6789/0 conn(0x7f6bb409b2f0 legacy=0x7f6bb409b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:11.967 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.966+0000 7f6bb2ffd640 1 -- 172.21.15.57:0/1952531966 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 60062835 0 0) 0x7f6bb409c990 con 0x7f6bb409b2f0 2024-04-24T02:05:11.967 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.966+0000 7f6bb37fe640 1 -- 172.21.15.57:0/1952531966 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb409ced0 con 0x7f6bb409be10 2024-04-24T02:05:11.967 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.967+0000 7f6bb37fe640 1 --2- 172.21.15.57:0/1952531966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb409be10 0x7f6bb4136420 crc :-1 s=READY pgs=12822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d99d5de06e92ea8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:11.968 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.967+0000 7f6bb2ffd640 1 -- 172.21.15.57:0/1952531966 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6ba800ad20 con 0x7f6bb409be10 2024-04-24T02:05:11.968 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.967+0000 7f6bb2ffd640 1 -- 172.21.15.57:0/1952531966 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6ba800ae80 con 0x7f6bb409be10 2024-04-24T02:05:11.968 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.967+0000 7f6bb2ffd640 1 -- 172.21.15.57:0/1952531966 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6ba800f470 con 0x7f6bb409be10 2024-04-24T02:05:11.969 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.967+0000 7f6bb959d640 1 -- 172.21.15.57:0/1952531966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb409be10 msgr2=0x7f6bb4136420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:11.969 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.967+0000 7f6bb959d640 1 --2- 172.21.15.57:0/1952531966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb409be10 0x7f6bb4136420 crc :-1 s=READY pgs=12822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:11.969 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.967+0000 7f6bb959d640 1 -- 172.21.15.57:0/1952531966 shutdown_connections 2024-04-24T02:05:11.969 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.967+0000 7f6bb959d640 1 --2- 172.21.15.57:0/1952531966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb409be10 0x7f6bb4136420 unknown :-1 s=CLOSED pgs=12822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:11.969 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.967+0000 7f6bb959d640 1 -- 172.21.15.57:0/1952531966 >> 172.21.15.57:0/1952531966 conn(0x7f6bb40a0700 msgr2=0x7f6bb40a0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:11.969 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.968+0000 7f6bb959d640 1 -- 172.21.15.57:0/1952531966 shutdown_connections 2024-04-24T02:05:11.969 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.968+0000 7f6bb959d640 1 -- 172.21.15.57:0/1952531966 wait complete. 2024-04-24T02:05:11.969 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.968+0000 7f6bb959d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:11.970 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.969+0000 7f6bb959d640 1 Processor -- start 2024-04-24T02:05:11.970 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.970+0000 7f6bb959d640 1 -- start start 2024-04-24T02:05:11.972 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.971+0000 7f6bb959d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb409b2f0 0x7f6bb41c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:11.972 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.971+0000 7f6bb959d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb41225d0 con 0x7f6bb409b2f0 2024-04-24T02:05:11.972 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.971+0000 7f6bb3fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb409b2f0 0x7f6bb41c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:11.972 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.971+0000 7f6bb3fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb409b2f0 0x7f6bb41c7500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34014/0 (socket says 172.21.15.57:34014) 2024-04-24T02:05:11.972 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.971+0000 7f6bb3fff640 1 -- 172.21.15.57:0/4292209276 learned_addr learned my addr 172.21.15.57:0/4292209276 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:05:11.972 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.972+0000 7f6bb3fff640 1 -- 172.21.15.57:0/4292209276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb41212f0 con 0x7f6bb409b2f0 2024-04-24T02:05:11.972 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.972+0000 7f6bb3fff640 1 --2- 172.21.15.57:0/4292209276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb409b2f0 0x7f6bb41c7500 crc :-1 s=READY pgs=12823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:11.974 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.972+0000 7f6bb0ff9640 1 -- 172.21.15.57:0/4292209276 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6ba4004b80 con 0x7f6bb409b2f0 2024-04-24T02:05:11.974 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.972+0000 7f6bb0ff9640 1 -- 172.21.15.57:0/4292209276 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6ba4004ce0 con 0x7f6bb409b2f0 2024-04-24T02:05:11.974 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.972+0000 7f6bb959d640 1 -- 172.21.15.57:0/4292209276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bb4124050 con 0x7f6bb409b2f0 2024-04-24T02:05:11.974 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.972+0000 7f6bb0ff9640 1 -- 172.21.15.57:0/4292209276 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6ba4007120 con 0x7f6bb409b2f0 2024-04-24T02:05:11.974 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.972+0000 7f6bb959d640 1 -- 172.21.15.57:0/4292209276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bb4131990 con 0x7f6bb409b2f0 2024-04-24T02:05:11.974 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.973+0000 7f6bb0ff9640 1 -- 172.21.15.57:0/4292209276 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f6ba40072d0 con 0x7f6bb409b2f0 2024-04-24T02:05:11.974 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.973+0000 7f6bb959d640 1 -- 172.21.15.57:0/4292209276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bb409df40 con 0x7f6bb409b2f0 2024-04-24T02:05:11.974 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.973+0000 7f6bb0ff9640 1 --2- 172.21.15.57:0/4292209276 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f6ba0038980 0x7f6ba003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:11.974 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.973+0000 7f6bb0ff9640 1 -- 172.21.15.57:0/4292209276 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(683..683 src has 395..683) ==== 3403+0+0 (crc 0 0 0) 0x7f6ba40485f0 con 0x7f6bb409b2f0 2024-04-24T02:05:11.974 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.974+0000 7f6bb37fe640 1 --2- 172.21.15.57:0/4292209276 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f6ba0038980 0x7f6ba003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:11.975 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.974+0000 7f6bb37fe640 1 --2- 172.21.15.57:0/4292209276 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f6ba0038980 0x7f6ba003ae90 crc :-1 s=READY pgs=3919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:11.979 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:11.979+0000 7f6bb0ff9640 1 -- 172.21.15.57:0/4292209276 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f6bb409df40 con 0x7f6bb409b2f0 2024-04-24T02:05:12.167 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:12.166+0000 7f6bb959d640 1 -- 172.21.15.57:0/4292209276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "pg_num": 12} v 0) -- 0x7f6bb409df40 con 0x7f6bb409b2f0 2024-04-24T02:05:12.714 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:12.714+0000 7f6bb0ff9640 1 -- 172.21.15.57:0/4292209276 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "pg_num": 12}]=0 pool '319496fe-d53f-40fe-a120-83451e8717ac' created v684) ==== 176+0+0 (crc 0 0 0) 0x7f6bb409df40 con 0x7f6bb409b2f0 2024-04-24T02:05:12.874 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:12.874+0000 7f6bb959d640 1 -- 172.21.15.57:0/4292209276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "pg_num": 12} v 0) -- 0x7f6bb409df40 con 0x7f6bb409b2f0 2024-04-24T02:05:12.875 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:12.875+0000 7f6bb0ff9640 1 -- 172.21.15.57:0/4292209276 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "pg_num": 12}]=0 pool '319496fe-d53f-40fe-a120-83451e8717ac' already exists v684) ==== 183+0+0 (crc 0 0 0) 0x7f6bb409df40 con 0x7f6bb409b2f0 2024-04-24T02:05:12.875 INFO:tasks.workunit.client.0.smithi057.stderr:pool '319496fe-d53f-40fe-a120-83451e8717ac' already exists 2024-04-24T02:05:12.878 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:12.877+0000 7f6bb959d640 1 -- 172.21.15.57:0/4292209276 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f6ba0038980 msgr2=0x7f6ba003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:12.878 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:12.877+0000 7f6bb959d640 1 --2- 172.21.15.57:0/4292209276 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f6ba0038980 0x7f6ba003ae90 crc :-1 s=READY pgs=3919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:12.878 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:12.877+0000 7f6bb959d640 1 -- 172.21.15.57:0/4292209276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb409b2f0 msgr2=0x7f6bb41c7500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:12.878 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:12.877+0000 7f6bb959d640 1 --2- 172.21.15.57:0/4292209276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb409b2f0 0x7f6bb41c7500 crc :-1 s=READY pgs=12823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:12.878 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:12.877+0000 7f6bb959d640 1 -- 172.21.15.57:0/4292209276 shutdown_connections 2024-04-24T02:05:12.878 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:12.877+0000 7f6bb959d640 1 --2- 172.21.15.57:0/4292209276 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f6ba0038980 0x7f6ba003ae90 unknown :-1 s=CLOSED pgs=3919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:12.878 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:12.877+0000 7f6bb959d640 1 --2- 172.21.15.57:0/4292209276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6bb409b2f0 0x7f6bb41c7500 unknown :-1 s=CLOSED pgs=12823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:12.878 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:12.877+0000 7f6bb959d640 1 -- 172.21.15.57:0/4292209276 >> 172.21.15.57:0/4292209276 conn(0x7f6bb40a0700 msgr2=0x7f6bb409d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:12.878 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:12.877+0000 7f6bb959d640 1 -- 172.21.15.57:0/4292209276 shutdown_connections 2024-04-24T02:05:12.878 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:12.877+0000 7f6bb959d640 1 -- 172.21.15.57:0/4292209276 wait complete. 2024-04-24T02:05:12.890 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph osd pool set-quota 319496fe-d53f-40fe-a120-83451e8717ac max_objects 10 2024-04-24T02:05:13.027 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.015+0000 7f4d0c664640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:13.028 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.028+0000 7f4d0c664640 1 Processor -- start 2024-04-24T02:05:13.028 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.028+0000 7f4d0c664640 1 -- start start 2024-04-24T02:05:13.032 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.030+0000 7f4d0c664640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4d04135060 0x7f4d04135470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:13.032 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.030+0000 7f4d0c664640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d041359b0 con 0x7f4d040a25b0 2024-04-24T02:05:13.032 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.030+0000 7f4d0c664640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f4d0409be70 con 0x7f4d04135060 2024-04-24T02:05:13.032 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.030+0000 7f4d0a400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4d04135060 0x7f4d04135470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:13.032 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.030+0000 7f4d09bff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4d040a25b0 0x7f4d040a29c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43544/0 (socket says 172.21.15.57:43544) 2024-04-24T02:05:13.032 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.030+0000 7f4d09bff640 1 -- 172.21.15.57:0/2679685532 learned_addr learned my addr 172.21.15.57:0/2679685532 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T02:05:13.032 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.031+0000 7f4d093fe640 1 -- 172.21.15.57:0/2679685532 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1770578688 0 0) 0x7f4d041359b0 con 0x7f4d040a25b0 2024-04-24T02:05:13.032 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.031+0000 7f4d093fe640 1 -- 172.21.15.57:0/2679685532 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cf0003580 con 0x7f4d040a25b0 2024-04-24T02:05:13.032 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.031+0000 7f4d0a400640 1 -- 172.21.15.57:0/2679685532 >> v1:172.21.15.57:6789/0 conn(0x7f4d040a25b0 legacy=0x7f4d040a29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:13.032 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.031+0000 7f4d0a400640 1 -- 172.21.15.57:0/2679685532 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d04134c30 con 0x7f4d04135060 2024-04-24T02:05:13.032 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.031+0000 7f4d0a400640 1 --2- 172.21.15.57:0/2679685532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d04135060 0x7f4d04135470 crc :-1 s=READY pgs=12825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e773f07a3b95b0d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:13.033 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.031+0000 7f4d093fe640 1 -- 172.21.15.57:0/2679685532 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4d00009d90 con 0x7f4d04135060 2024-04-24T02:05:13.033 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.031+0000 7f4d093fe640 1 -- 172.21.15.57:0/2679685532 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4d0000e230 con 0x7f4d04135060 2024-04-24T02:05:13.033 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.031+0000 7f4d093fe640 1 -- 172.21.15.57:0/2679685532 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4d0000e4d0 con 0x7f4d04135060 2024-04-24T02:05:13.034 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.032+0000 7f4d0c664640 1 -- 172.21.15.57:0/2679685532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d04135060 msgr2=0x7f4d04135470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:13.034 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.032+0000 7f4d0c664640 1 --2- 172.21.15.57:0/2679685532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d04135060 0x7f4d04135470 crc :-1 s=READY pgs=12825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:13.034 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.033+0000 7f4d0c664640 1 -- 172.21.15.57:0/2679685532 shutdown_connections 2024-04-24T02:05:13.034 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.033+0000 7f4d0c664640 1 --2- 172.21.15.57:0/2679685532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d04135060 0x7f4d04135470 unknown :-1 s=CLOSED pgs=12825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:13.034 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.033+0000 7f4d0c664640 1 -- 172.21.15.57:0/2679685532 >> 172.21.15.57:0/2679685532 conn(0x7f4d0406d420 msgr2=0x7f4d0406d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:13.034 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.033+0000 7f4d0c664640 1 -- 172.21.15.57:0/2679685532 shutdown_connections 2024-04-24T02:05:13.034 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.033+0000 7f4d0c664640 1 -- 172.21.15.57:0/2679685532 wait complete. 2024-04-24T02:05:13.034 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.033+0000 7f4d0c664640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:13.035 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.035+0000 7f4d0c664640 1 Processor -- start 2024-04-24T02:05:13.035 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.035+0000 7f4d0c664640 1 -- start start 2024-04-24T02:05:13.037 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.036+0000 7f4d0c664640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d040a25b0 0x7f4d041c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:13.038 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.036+0000 7f4d0c664640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0409fd10 con 0x7f4d040a25b0 2024-04-24T02:05:13.038 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.036+0000 7f4d0a400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d040a25b0 0x7f4d041c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:13.038 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.036+0000 7f4d0a400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d040a25b0 0x7f4d041c9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34030/0 (socket says 172.21.15.57:34030) 2024-04-24T02:05:13.038 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.036+0000 7f4d0a400640 1 -- 172.21.15.57:0/3170910959 learned_addr learned my addr 172.21.15.57:0/3170910959 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:05:13.038 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.037+0000 7f4d0a400640 1 -- 172.21.15.57:0/3170910959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d040a0630 con 0x7f4d040a25b0 2024-04-24T02:05:13.038 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.037+0000 7f4d0a400640 1 --2- 172.21.15.57:0/3170910959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d040a25b0 0x7f4d041c9de0 crc :-1 s=READY pgs=12826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:13.038 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.037+0000 7f4cfaffd640 1 -- 172.21.15.57:0/3170910959 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4d00014540 con 0x7f4d040a25b0 2024-04-24T02:05:13.038 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.037+0000 7f4d0c664640 1 -- 172.21.15.57:0/3170910959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d04135bc0 con 0x7f4d040a25b0 2024-04-24T02:05:13.038 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.037+0000 7f4cfaffd640 1 -- 172.21.15.57:0/3170910959 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4d000146a0 con 0x7f4d040a25b0 2024-04-24T02:05:13.038 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.037+0000 7f4cfaffd640 1 -- 172.21.15.57:0/3170910959 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4d00014940 con 0x7f4d040a25b0 2024-04-24T02:05:13.038 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.037+0000 7f4d0c664640 1 -- 172.21.15.57:0/3170910959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d0411d580 con 0x7f4d040a25b0 2024-04-24T02:05:13.039 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.038+0000 7f4cfaffd640 1 -- 172.21.15.57:0/3170910959 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f4d00014b40 con 0x7f4d040a25b0 2024-04-24T02:05:13.039 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.039+0000 7f4cfaffd640 1 --2- 172.21.15.57:0/3170910959 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f4ce8038960 0x7f4ce803ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:13.039 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.039+0000 7f4cfaffd640 1 -- 172.21.15.57:0/3170910959 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(684..684 src has 395..684) ==== 3778+0+0 (crc 0 0 0) 0x7f4d00019040 con 0x7f4d040a25b0 2024-04-24T02:05:13.039 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.039+0000 7f4d0c664640 1 -- 172.21.15.57:0/3170910959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d0409c810 con 0x7f4d040a25b0 2024-04-24T02:05:13.039 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.039+0000 7f4d09bff640 1 --2- 172.21.15.57:0/3170910959 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f4ce8038960 0x7f4ce803ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:13.040 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.040+0000 7f4d09bff640 1 --2- 172.21.15.57:0/3170910959 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f4ce8038960 0x7f4ce803ae70 crc :-1 s=READY pgs=3920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:13.045 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.045+0000 7f4cfaffd640 1 -- 172.21.15.57:0/3170910959 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f4d00014e40 con 0x7f4d040a25b0 2024-04-24T02:05:13.246 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.246+0000 7f4d0c664640 1 -- 172.21.15.57:0/3170910959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "field": "max_objects", "val": "10"} v 0) -- 0x7f4d04069870 con 0x7f4d040a25b0 2024-04-24T02:05:13.723 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.723+0000 7f4cfaffd640 1 -- 172.21.15.57:0/3170910959 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 319496fe-d53f-40fe-a120-83451e8717ac v685) ==== 223+0+0 (crc 0 0 0) 0x7f4d0000f7b0 con 0x7f4d040a25b0 2024-04-24T02:05:13.872 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:13.872+0000 7f4d0c664640 1 -- 172.21.15.57:0/3170910959 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "field": "max_objects", "val": "10"} v 0) -- 0x7f4d041337a0 con 0x7f4d040a25b0 2024-04-24T02:05:14.724 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.723+0000 7f4cfaffd640 1 -- 172.21.15.57:0/3170910959 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 319496fe-d53f-40fe-a120-83451e8717ac v686) ==== 223+0+0 (crc 0 0 0) 0x7f4d0000fba0 con 0x7f4d040a25b0 2024-04-24T02:05:14.725 INFO:tasks.workunit.client.0.smithi057.stderr:set-quota max_objects = 10 for pool 319496fe-d53f-40fe-a120-83451e8717ac 2024-04-24T02:05:14.727 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.725+0000 7f4d0c664640 1 -- 172.21.15.57:0/3170910959 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f4ce8038960 msgr2=0x7f4ce803ae70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:14.727 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.725+0000 7f4d0c664640 1 --2- 172.21.15.57:0/3170910959 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f4ce8038960 0x7f4ce803ae70 crc :-1 s=READY pgs=3920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:14.727 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.725+0000 7f4d0c664640 1 -- 172.21.15.57:0/3170910959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d040a25b0 msgr2=0x7f4d041c9de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:14.727 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.725+0000 7f4d0c664640 1 --2- 172.21.15.57:0/3170910959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d040a25b0 0x7f4d041c9de0 crc :-1 s=READY pgs=12826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:14.727 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.725+0000 7f4d0c664640 1 -- 172.21.15.57:0/3170910959 shutdown_connections 2024-04-24T02:05:14.727 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.725+0000 7f4d0c664640 1 --2- 172.21.15.57:0/3170910959 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f4ce8038960 0x7f4ce803ae70 unknown :-1 s=CLOSED pgs=3920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:14.727 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.725+0000 7f4d0c664640 1 --2- 172.21.15.57:0/3170910959 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d040a25b0 0x7f4d041c9de0 unknown :-1 s=CLOSED pgs=12826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:14.728 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.725+0000 7f4d0c664640 1 -- 172.21.15.57:0/3170910959 >> 172.21.15.57:0/3170910959 conn(0x7f4d0406d420 msgr2=0x7f4d041bcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:14.728 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.726+0000 7f4d0c664640 1 -- 172.21.15.57:0/3170910959 shutdown_connections 2024-04-24T02:05:14.728 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.726+0000 7f4d0c664640 1 -- 172.21.15.57:0/3170910959 wait complete. 2024-04-24T02:05:14.739 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph osd pool application enable 319496fe-d53f-40fe-a120-83451e8717ac rados 2024-04-24T02:05:14.893 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.883+0000 7f315ef9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:14.894 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.893+0000 7f315ef9d640 1 Processor -- start 2024-04-24T02:05:14.895 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.893+0000 7f315ef9d640 1 -- start start 2024-04-24T02:05:14.897 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.895+0000 7f315ef9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3158135060 0x7f3158135470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:14.897 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.895+0000 7f315ef9d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31581359b0 con 0x7f31580a25b0 2024-04-24T02:05:14.897 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.895+0000 7f315ef9d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f315809be70 con 0x7f3158135060 2024-04-24T02:05:14.898 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.895+0000 7f315cd39640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3158135060 0x7f3158135470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:14.898 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.895+0000 7f3157fff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f31580a25b0 0x7f31580a29c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:43554/0 (socket says 172.21.15.57:43554) 2024-04-24T02:05:14.898 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.895+0000 7f3157fff640 1 -- 172.21.15.57:0/2328050208 learned_addr learned my addr 172.21.15.57:0/2328050208 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T02:05:14.898 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.896+0000 7f31577fe640 1 -- 172.21.15.57:0/2328050208 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3019721406 0 0) 0x7f31581359b0 con 0x7f31580a25b0 2024-04-24T02:05:14.898 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.896+0000 7f31577fe640 1 -- 172.21.15.57:0/2328050208 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3148003580 con 0x7f31580a25b0 2024-04-24T02:05:14.898 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.896+0000 7f315cd39640 1 -- 172.21.15.57:0/2328050208 >> v1:172.21.15.57:6789/0 conn(0x7f31580a25b0 legacy=0x7f31580a29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:14.898 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.896+0000 7f315cd39640 1 -- 172.21.15.57:0/2328050208 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3158134c30 con 0x7f3158135060 2024-04-24T02:05:14.898 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.896+0000 7f315cd39640 1 --2- 172.21.15.57:0/2328050208 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3158135060 0x7f3158135470 crc :-1 s=READY pgs=12828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fedd3d8ee28b0b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:14.898 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.896+0000 7f31577fe640 1 -- 172.21.15.57:0/2328050208 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f314c009d90 con 0x7f3158135060 2024-04-24T02:05:14.898 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.896+0000 7f31577fe640 1 -- 172.21.15.57:0/2328050208 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f314c00e230 con 0x7f3158135060 2024-04-24T02:05:14.898 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.896+0000 7f31577fe640 1 -- 172.21.15.57:0/2328050208 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f314c00e4d0 con 0x7f3158135060 2024-04-24T02:05:14.899 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.897+0000 7f315ef9d640 1 -- 172.21.15.57:0/2328050208 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3158135060 msgr2=0x7f3158135470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:14.899 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.897+0000 7f315ef9d640 1 --2- 172.21.15.57:0/2328050208 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3158135060 0x7f3158135470 crc :-1 s=READY pgs=12828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:14.899 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.897+0000 7f315ef9d640 1 -- 172.21.15.57:0/2328050208 shutdown_connections 2024-04-24T02:05:14.899 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.897+0000 7f315ef9d640 1 --2- 172.21.15.57:0/2328050208 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3158135060 0x7f3158135470 unknown :-1 s=CLOSED pgs=12828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:14.900 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.897+0000 7f315ef9d640 1 -- 172.21.15.57:0/2328050208 >> 172.21.15.57:0/2328050208 conn(0x7f315806d420 msgr2=0x7f315806d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:14.900 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.897+0000 7f315ef9d640 1 -- 172.21.15.57:0/2328050208 shutdown_connections 2024-04-24T02:05:14.900 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.897+0000 7f315ef9d640 1 -- 172.21.15.57:0/2328050208 wait complete. 2024-04-24T02:05:14.900 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.898+0000 7f315ef9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:14.900 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.899+0000 7f315ef9d640 1 Processor -- start 2024-04-24T02:05:14.900 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.899+0000 7f315ef9d640 1 -- start start 2024-04-24T02:05:14.902 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.901+0000 7f315ef9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31580a25b0 0x7f31581c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:14.903 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.901+0000 7f315ef9d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f315809fd10 con 0x7f31580a25b0 2024-04-24T02:05:14.903 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.901+0000 7f315cd39640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31580a25b0 0x7f31581c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:14.903 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.901+0000 7f315cd39640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31580a25b0 0x7f31581c9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34046/0 (socket says 172.21.15.57:34046) 2024-04-24T02:05:14.903 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.901+0000 7f315cd39640 1 -- 172.21.15.57:0/2508205686 learned_addr learned my addr 172.21.15.57:0/2508205686 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:05:14.904 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.902+0000 7f315cd39640 1 -- 172.21.15.57:0/2508205686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31580a0630 con 0x7f31580a25b0 2024-04-24T02:05:14.904 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.902+0000 7f315cd39640 1 --2- 172.21.15.57:0/2508205686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31580a25b0 0x7f31581c9de0 crc :-1 s=READY pgs=12829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:14.904 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.902+0000 7f31557fa640 1 -- 172.21.15.57:0/2508205686 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f314c014540 con 0x7f31580a25b0 2024-04-24T02:05:14.904 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.902+0000 7f31557fa640 1 -- 172.21.15.57:0/2508205686 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f314c0146a0 con 0x7f31580a25b0 2024-04-24T02:05:14.904 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.902+0000 7f31557fa640 1 -- 172.21.15.57:0/2508205686 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f314c014940 con 0x7f31580a25b0 2024-04-24T02:05:14.904 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.902+0000 7f315ef9d640 1 -- 172.21.15.57:0/2508205686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3158135bc0 con 0x7f31580a25b0 2024-04-24T02:05:14.904 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.902+0000 7f315ef9d640 1 -- 172.21.15.57:0/2508205686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f315811d580 con 0x7f31580a25b0 2024-04-24T02:05:14.905 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.903+0000 7f31557fa640 1 -- 172.21.15.57:0/2508205686 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f314c014b40 con 0x7f31580a25b0 2024-04-24T02:05:14.905 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.904+0000 7f31557fa640 1 --2- 172.21.15.57:0/2508205686 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f313c038960 0x7f313c03ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:14.905 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.904+0000 7f31557fa640 1 -- 172.21.15.57:0/2508205686 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(686..686 src has 395..686) ==== 3778+0+0 (crc 0 0 0) 0x7f314c019040 con 0x7f31580a25b0 2024-04-24T02:05:14.906 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.904+0000 7f315ef9d640 1 -- 172.21.15.57:0/2508205686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f315809c810 con 0x7f31580a25b0 2024-04-24T02:05:14.906 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.904+0000 7f3157fff640 1 --2- 172.21.15.57:0/2508205686 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f313c038960 0x7f313c03ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:14.906 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.905+0000 7f3157fff640 1 --2- 172.21.15.57:0/2508205686 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f313c038960 0x7f313c03ae70 crc :-1 s=READY pgs=3921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:14.911 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:14.910+0000 7f31557fa640 1 -- 172.21.15.57:0/2508205686 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f314c014e40 con 0x7f31580a25b0 2024-04-24T02:05:15.149 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:15.148+0000 7f315ef9d640 1 -- 172.21.15.57:0/2508205686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "app": "rados"} v 0) -- 0x7f3158069870 con 0x7f31580a25b0 2024-04-24T02:05:15.735 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:15.734+0000 7f31557fa640 1 -- 172.21.15.57:0/2508205686 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "app": "rados"}]=0 enabled application 'rados' on pool '319496fe-d53f-40fe-a120-83451e8717ac' v687) ==== 213+0+0 (crc 0 0 0) 0x7f314c00f7b0 con 0x7f31580a25b0 2024-04-24T02:05:15.847 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:15.845+0000 7f315ef9d640 1 -- 172.21.15.57:0/2508205686 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "app": "rados"} v 0) -- 0x7f31581337a0 con 0x7f31580a25b0 2024-04-24T02:05:16.741 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.740+0000 7f31557fa640 1 -- 172.21.15.57:0/2508205686 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "app": "rados"}]=0 enabled application 'rados' on pool '319496fe-d53f-40fe-a120-83451e8717ac' v688) ==== 213+0+0 (crc 0 0 0) 0x7f314c00fba0 con 0x7f31580a25b0 2024-04-24T02:05:16.741 INFO:tasks.workunit.client.0.smithi057.stderr:enabled application 'rados' on pool '319496fe-d53f-40fe-a120-83451e8717ac' 2024-04-24T02:05:16.744 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.742+0000 7f315ef9d640 1 -- 172.21.15.57:0/2508205686 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f313c038960 msgr2=0x7f313c03ae70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:16.744 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.742+0000 7f315ef9d640 1 --2- 172.21.15.57:0/2508205686 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f313c038960 0x7f313c03ae70 crc :-1 s=READY pgs=3921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:16.744 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.742+0000 7f315ef9d640 1 -- 172.21.15.57:0/2508205686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31580a25b0 msgr2=0x7f31581c9de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:16.744 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.742+0000 7f315ef9d640 1 --2- 172.21.15.57:0/2508205686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31580a25b0 0x7f31581c9de0 crc :-1 s=READY pgs=12829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:16.744 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.742+0000 7f315ef9d640 1 -- 172.21.15.57:0/2508205686 shutdown_connections 2024-04-24T02:05:16.744 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.742+0000 7f315ef9d640 1 --2- 172.21.15.57:0/2508205686 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f313c038960 0x7f313c03ae70 unknown :-1 s=CLOSED pgs=3921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:16.744 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.742+0000 7f315ef9d640 1 --2- 172.21.15.57:0/2508205686 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f31580a25b0 0x7f31581c9de0 unknown :-1 s=CLOSED pgs=12829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:16.744 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.742+0000 7f315ef9d640 1 -- 172.21.15.57:0/2508205686 >> 172.21.15.57:0/2508205686 conn(0x7f315806d420 msgr2=0x7f31581bcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:16.744 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.742+0000 7f315ef9d640 1 -- 172.21.15.57:0/2508205686 shutdown_connections 2024-04-24T02:05:16.744 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.742+0000 7f315ef9d640 1 -- 172.21.15.57:0/2508205686 wait complete. 2024-04-24T02:05:16.754 INFO:tasks.workunit.client.0.smithi057.stderr:++ seq 1 10 2024-04-24T02:05:16.776 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in `seq 1 10` 2024-04-24T02:05:16.776 INFO:tasks.workunit.client.0.smithi057.stderr:+ rados -p 319496fe-d53f-40fe-a120-83451e8717ac put obj1 /etc/passwd 2024-04-24T02:05:16.814 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.813+0000 7f6f62032ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:16.820 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.819+0000 7f6f62032ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:16.820 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.819+0000 7f6f62032ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:16.821 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.820+0000 7f6f62032ec0 1 Processor -- start 2024-04-24T02:05:16.821 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.820+0000 7f6f62032ec0 1 -- start start 2024-04-24T02:05:16.823 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.821+0000 7f6f62032ec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x646050 0x7604f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:16.823 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.821+0000 7f6f62032ec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5ac950 con 0x646050 2024-04-24T02:05:16.823 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.821+0000 7f6f5a19b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x646050 0x7604f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:16.823 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.821+0000 7f6f5a19b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x646050 0x7604f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34074/0 (socket says 172.21.15.57:34074) 2024-04-24T02:05:16.823 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.821+0000 7f6f5a19b640 1 -- 172.21.15.57:0/1556451926 learned_addr learned my addr 172.21.15.57:0/1556451926 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:05:16.823 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.821+0000 7f6f5a19b640 1 -- 172.21.15.57:0/1556451926 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x54b1e0 con 0x646050 2024-04-24T02:05:16.823 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.822+0000 7f6f5a19b640 1 --2- 172.21.15.57:0/1556451926 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x646050 0x7604f0 crc :-1 s=READY pgs=12832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f57231b8628906e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:16.823 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.822+0000 7f6f58998640 1 -- 172.21.15.57:0/1556451926 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6f4c032040 con 0x646050 2024-04-24T02:05:16.823 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.822+0000 7f6f58998640 1 -- 172.21.15.57:0/1556451926 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6f4c00a040 con 0x646050 2024-04-24T02:05:16.823 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.822+0000 7f6f58998640 1 -- 172.21.15.57:0/1556451926 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6f4c00a2e0 con 0x646050 2024-04-24T02:05:16.824 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.822+0000 7f6f62032ec0 1 -- 172.21.15.57:0/1556451926 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x646050 msgr2=0x7604f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:16.824 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.822+0000 7f6f62032ec0 1 --2- 172.21.15.57:0/1556451926 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x646050 0x7604f0 crc :-1 s=READY pgs=12832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:16.825 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.822+0000 7f6f62032ec0 1 -- 172.21.15.57:0/1556451926 shutdown_connections 2024-04-24T02:05:16.825 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.822+0000 7f6f62032ec0 1 --2- 172.21.15.57:0/1556451926 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x646050 0x7604f0 unknown :-1 s=CLOSED pgs=12832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:16.825 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.822+0000 7f6f62032ec0 1 -- 172.21.15.57:0/1556451926 >> 172.21.15.57:0/1556451926 conn(0x563960 msgr2=0x64b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:16.825 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.822+0000 7f6f62032ec0 1 -- 172.21.15.57:0/1556451926 shutdown_connections 2024-04-24T02:05:16.825 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.823+0000 7f6f62032ec0 1 -- 172.21.15.57:0/1556451926 wait complete. 2024-04-24T02:05:16.825 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.823+0000 7f6f62032ec0 1 Processor -- start 2024-04-24T02:05:16.825 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.824+0000 7f6f62032ec0 1 -- start start 2024-04-24T02:05:16.827 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.825+0000 7f6f62032ec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x646050 0x6c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:16.827 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.825+0000 7f6f62032ec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x5aa3d0 con 0x646050 2024-04-24T02:05:16.827 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.825+0000 7f6f5a19b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x646050 0x6c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:16.827 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.825+0000 7f6f5a19b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x646050 0x6c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34078/0 (socket says 172.21.15.57:34078) 2024-04-24T02:05:16.827 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.825+0000 7f6f5a19b640 1 -- 172.21.15.57:0/689618680 learned_addr learned my addr 172.21.15.57:0/689618680 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:05:16.827 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.825+0000 7f6f5a19b640 1 -- 172.21.15.57:0/689618680 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x53de30 con 0x646050 2024-04-24T02:05:16.827 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.826+0000 7f6f5a19b640 1 --2- 172.21.15.57:0/689618680 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x646050 0x6c4760 crc :-1 s=READY pgs=12833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:16.827 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.826+0000 7f6f52ffd640 1 -- 172.21.15.57:0/689618680 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6f4c02d570 con 0x646050 2024-04-24T02:05:16.827 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.826+0000 7f6f52ffd640 1 -- 172.21.15.57:0/689618680 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6f4c02d6d0 con 0x646050 2024-04-24T02:05:16.828 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.826+0000 7f6f62032ec0 1 -- 172.21.15.57:0/689618680 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x53d890 con 0x646050 2024-04-24T02:05:16.828 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.826+0000 7f6f52ffd640 1 -- 172.21.15.57:0/689618680 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6f4c02d970 con 0x646050 2024-04-24T02:05:16.828 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.826+0000 7f6f62032ec0 1 -- 172.21.15.57:0/689618680 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x6d9010 con 0x646050 2024-04-24T02:05:16.829 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.827+0000 7f6f52ffd640 1 -- 172.21.15.57:0/689618680 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f6f4c02db60 con 0x646050 2024-04-24T02:05:16.829 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.827+0000 7f6f52ffd640 1 --2- 172.21.15.57:0/689618680 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f6f340371c0 0x7f6f340396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:16.829 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.827+0000 7f6f52ffd640 1 -- 172.21.15.57:0/689618680 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(688..688 src has 395..688) ==== 3791+0+0 (crc 0 0 0) 0x7f6f4c032040 con 0x646050 2024-04-24T02:05:16.829 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.827+0000 7f6f5999a640 1 --2- 172.21.15.57:0/689618680 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f6f340371c0 0x7f6f340396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:16.829 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.827+0000 7f6f62032ec0 1 --2- 172.21.15.57:0/689618680 >> v2:172.21.15.84:6808/91137974 conn(0x646e20 0x6c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:16.829 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.827+0000 7f6f62032ec0 1 -- 172.21.15.57:0/689618680 --> v2:172.21.15.84:6808/91137974 -- osd_op(unknown.0.0:1 200.7 200:ff7b1f36:::obj1:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e688) -- 0x6c8190 con 0x646e20 2024-04-24T02:05:16.829 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.828+0000 7f6f5999a640 1 --2- 172.21.15.57:0/689618680 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f6f340371c0 0x7f6f340396d0 crc :-1 s=READY pgs=3922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:16.829 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.828+0000 7f6f5a99c640 1 --2- 172.21.15.57:0/689618680 >> v2:172.21.15.84:6808/91137974 conn(0x646e20 0x6c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T02:05:16.831 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:16.830+0000 7f6f5a99c640 1 --2- 172.21.15.57:0/689618680 >> v2:172.21.15.84:6808/91137974 conn(0x646e20 0x6c51b0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.052 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.049+0000 7f6f5a99c640 1 -- 172.21.15.57:0/689618680 <== osd.3 v2:172.21.15.84:6808/91137974 1 ==== osd_op_reply(1 obj1 [writefull 0~11876] v688'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f6f4400a430 con 0x646e20 2024-04-24T02:05:17.052 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.050+0000 7f6f62032ec0 1 -- 172.21.15.57:0/689618680 >> v2:172.21.15.84:6808/91137974 conn(0x646e20 msgr2=0x6c51b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.052 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.050+0000 7f6f62032ec0 1 --2- 172.21.15.57:0/689618680 >> v2:172.21.15.84:6808/91137974 conn(0x646e20 0x6c51b0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.052 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.050+0000 7f6f62032ec0 1 -- 172.21.15.57:0/689618680 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f6f340371c0 msgr2=0x7f6f340396d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.052 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.050+0000 7f6f62032ec0 1 --2- 172.21.15.57:0/689618680 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f6f340371c0 0x7f6f340396d0 crc :-1 s=READY pgs=3922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.052 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.050+0000 7f6f62032ec0 1 -- 172.21.15.57:0/689618680 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x646050 msgr2=0x6c4760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.052 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.050+0000 7f6f62032ec0 1 --2- 172.21.15.57:0/689618680 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x646050 0x6c4760 crc :-1 s=READY pgs=12833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.052 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.050+0000 7f6f62032ec0 1 -- 172.21.15.57:0/689618680 shutdown_connections 2024-04-24T02:05:17.052 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.050+0000 7f6f62032ec0 1 --2- 172.21.15.57:0/689618680 >> v2:172.21.15.84:6808/91137974 conn(0x646e20 0x6c51b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.052 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.050+0000 7f6f62032ec0 1 --2- 172.21.15.57:0/689618680 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f6f340371c0 0x7f6f340396d0 unknown :-1 s=CLOSED pgs=3922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.053 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.050+0000 7f6f62032ec0 1 --2- 172.21.15.57:0/689618680 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x646050 0x6c4760 unknown :-1 s=CLOSED pgs=12833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.053 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.050+0000 7f6f62032ec0 1 -- 172.21.15.57:0/689618680 >> 172.21.15.57:0/689618680 conn(0x563960 msgr2=0x7628b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:17.053 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.050+0000 7f6f62032ec0 1 -- 172.21.15.57:0/689618680 shutdown_connections 2024-04-24T02:05:17.053 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.050+0000 7f6f62032ec0 1 -- 172.21.15.57:0/689618680 wait complete. 2024-04-24T02:05:17.053 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in `seq 1 10` 2024-04-24T02:05:17.053 INFO:tasks.workunit.client.0.smithi057.stderr:+ rados -p 319496fe-d53f-40fe-a120-83451e8717ac put obj2 /etc/passwd 2024-04-24T02:05:17.092 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.091+0000 7fe19895cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:17.098 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.097+0000 7fe19895cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:17.098 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.097+0000 7fe19895cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:17.099 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.098+0000 7fe19895cec0 1 Processor -- start 2024-04-24T02:05:17.099 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.098+0000 7fe19895cec0 1 -- start start 2024-04-24T02:05:17.101 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.099+0000 7fe19895cec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x133fbe0 0x133ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.101 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.099+0000 7fe19895cec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x12a6950 con 0x133fbe0 2024-04-24T02:05:17.101 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.099+0000 7fe19139b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x133fbe0 0x133ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:17.101 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.100+0000 7fe19139b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x133fbe0 0x133ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34094/0 (socket says 172.21.15.57:34094) 2024-04-24T02:05:17.101 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.100+0000 7fe19139b640 1 -- 172.21.15.57:0/1727136076 learned_addr learned my addr 172.21.15.57:0/1727136076 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:05:17.102 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.100+0000 7fe19139b640 1 -- 172.21.15.57:0/1727136076 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x12451e0 con 0x133fbe0 2024-04-24T02:05:17.102 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.100+0000 7fe19139b640 1 --2- 172.21.15.57:0/1727136076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x133fbe0 0x133ae50 crc :-1 s=READY pgs=12836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba346152a12c4e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.102 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.100+0000 7fe18affd640 1 -- 172.21.15.57:0/1727136076 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe17c00b500 con 0x133fbe0 2024-04-24T02:05:17.102 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.100+0000 7fe18affd640 1 -- 172.21.15.57:0/1727136076 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe17c00b660 con 0x133fbe0 2024-04-24T02:05:17.102 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.100+0000 7fe18affd640 1 -- 172.21.15.57:0/1727136076 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe17c00b900 con 0x133fbe0 2024-04-24T02:05:17.103 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.101+0000 7fe19895cec0 1 -- 172.21.15.57:0/1727136076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x133fbe0 msgr2=0x133ae50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.103 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.101+0000 7fe19895cec0 1 --2- 172.21.15.57:0/1727136076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x133fbe0 0x133ae50 crc :-1 s=READY pgs=12836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.103 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.101+0000 7fe19895cec0 1 -- 172.21.15.57:0/1727136076 shutdown_connections 2024-04-24T02:05:17.103 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.101+0000 7fe19895cec0 1 --2- 172.21.15.57:0/1727136076 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x133fbe0 0x133ae50 unknown :-1 s=CLOSED pgs=12836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.103 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.101+0000 7fe19895cec0 1 -- 172.21.15.57:0/1727136076 >> 172.21.15.57:0/1727136076 conn(0x125d960 msgr2=0x145b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:17.103 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.101+0000 7fe19895cec0 1 -- 172.21.15.57:0/1727136076 shutdown_connections 2024-04-24T02:05:17.103 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.101+0000 7fe19895cec0 1 -- 172.21.15.57:0/1727136076 wait complete. 2024-04-24T02:05:17.103 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.102+0000 7fe19895cec0 1 Processor -- start 2024-04-24T02:05:17.104 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.102+0000 7fe19895cec0 1 -- start start 2024-04-24T02:05:17.105 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.103+0000 7fe19895cec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x133fbe0 0x14690b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.105 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.103+0000 7fe19895cec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x12a43d0 con 0x133fbe0 2024-04-24T02:05:17.106 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.103+0000 7fe19139b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x133fbe0 0x14690b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:17.106 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.104+0000 7fe19139b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x133fbe0 0x14690b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34104/0 (socket says 172.21.15.57:34104) 2024-04-24T02:05:17.106 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.104+0000 7fe19139b640 1 -- 172.21.15.57:0/1437600180 learned_addr learned my addr 172.21.15.57:0/1437600180 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:05:17.106 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.104+0000 7fe19139b640 1 -- 172.21.15.57:0/1437600180 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1237e30 con 0x133fbe0 2024-04-24T02:05:17.106 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.104+0000 7fe19139b640 1 --2- 172.21.15.57:0/1437600180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x133fbe0 0x14690b0 crc :-1 s=READY pgs=12837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.106 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.104+0000 7fe189ffb640 1 -- 172.21.15.57:0/1437600180 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe17c0129e0 con 0x133fbe0 2024-04-24T02:05:17.106 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.104+0000 7fe189ffb640 1 -- 172.21.15.57:0/1437600180 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe17c005040 con 0x133fbe0 2024-04-24T02:05:17.106 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.104+0000 7fe19895cec0 1 -- 172.21.15.57:0/1437600180 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1237890 con 0x133fbe0 2024-04-24T02:05:17.106 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.104+0000 7fe189ffb640 1 -- 172.21.15.57:0/1437600180 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe17c012c70 con 0x133fbe0 2024-04-24T02:05:17.106 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.104+0000 7fe19895cec0 1 -- 172.21.15.57:0/1437600180 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1326a70 con 0x133fbe0 2024-04-24T02:05:17.107 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.105+0000 7fe189ffb640 1 -- 172.21.15.57:0/1437600180 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fe17c00d040 con 0x133fbe0 2024-04-24T02:05:17.107 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.105+0000 7fe189ffb640 1 --2- 172.21.15.57:0/1437600180 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fe178037210 0x7fe178039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.107 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.105+0000 7fe189ffb640 1 -- 172.21.15.57:0/1437600180 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(688..688 src has 395..688) ==== 3791+0+0 (crc 0 0 0) 0x7fe17c00a040 con 0x133fbe0 2024-04-24T02:05:17.107 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.105+0000 7fe19895cec0 1 --2- 172.21.15.57:0/1437600180 >> v2:172.21.15.84:6808/91137974 conn(0x1341c50 0x1445820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.108 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.105+0000 7fe19895cec0 1 -- 172.21.15.57:0/1437600180 --> v2:172.21.15.84:6808/91137974 -- osd_op(unknown.0.0:1 200.8 200:104778fc:::obj2:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e688) -- 0x1326270 con 0x1341c50 2024-04-24T02:05:17.108 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.106+0000 7fe190b9a640 1 --2- 172.21.15.57:0/1437600180 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fe178037210 0x7fe178039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:17.108 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.106+0000 7fe191b9c640 1 --2- 172.21.15.57:0/1437600180 >> v2:172.21.15.84:6808/91137974 conn(0x1341c50 0x1445820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T02:05:17.108 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.106+0000 7fe190b9a640 1 --2- 172.21.15.57:0/1437600180 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fe178037210 0x7fe178039720 crc :-1 s=READY pgs=3923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.110 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.109+0000 7fe191b9c640 1 --2- 172.21.15.57:0/1437600180 >> v2:172.21.15.84:6808/91137974 conn(0x1341c50 0x1445820 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.120 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.118+0000 7fe191b9c640 1 -- 172.21.15.57:0/1437600180 <== osd.3 v2:172.21.15.84:6808/91137974 1 ==== osd_op_reply(1 obj2 [writefull 0~11876] v688'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fe18400a430 con 0x1341c50 2024-04-24T02:05:17.120 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.119+0000 7fe19895cec0 1 -- 172.21.15.57:0/1437600180 >> v2:172.21.15.84:6808/91137974 conn(0x1341c50 msgr2=0x1445820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.121 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.119+0000 7fe19895cec0 1 --2- 172.21.15.57:0/1437600180 >> v2:172.21.15.84:6808/91137974 conn(0x1341c50 0x1445820 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.121 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.119+0000 7fe19895cec0 1 -- 172.21.15.57:0/1437600180 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fe178037210 msgr2=0x7fe178039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.121 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.119+0000 7fe19895cec0 1 --2- 172.21.15.57:0/1437600180 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fe178037210 0x7fe178039720 crc :-1 s=READY pgs=3923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.121 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.119+0000 7fe19895cec0 1 -- 172.21.15.57:0/1437600180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x133fbe0 msgr2=0x14690b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.121 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.119+0000 7fe19895cec0 1 --2- 172.21.15.57:0/1437600180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x133fbe0 0x14690b0 crc :-1 s=READY pgs=12837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.121 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.119+0000 7fe19895cec0 1 -- 172.21.15.57:0/1437600180 shutdown_connections 2024-04-24T02:05:17.121 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.119+0000 7fe19895cec0 1 --2- 172.21.15.57:0/1437600180 >> v2:172.21.15.84:6808/91137974 conn(0x1341c50 0x1445820 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.121 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.119+0000 7fe19895cec0 1 --2- 172.21.15.57:0/1437600180 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fe178037210 0x7fe178039720 unknown :-1 s=CLOSED pgs=3923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.121 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.119+0000 7fe19895cec0 1 --2- 172.21.15.57:0/1437600180 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x133fbe0 0x14690b0 unknown :-1 s=CLOSED pgs=12837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.121 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.119+0000 7fe19895cec0 1 -- 172.21.15.57:0/1437600180 >> 172.21.15.57:0/1437600180 conn(0x125d960 msgr2=0x145b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:17.121 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.119+0000 7fe19895cec0 1 -- 172.21.15.57:0/1437600180 shutdown_connections 2024-04-24T02:05:17.121 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.119+0000 7fe19895cec0 1 -- 172.21.15.57:0/1437600180 wait complete. 2024-04-24T02:05:17.122 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in `seq 1 10` 2024-04-24T02:05:17.122 INFO:tasks.workunit.client.0.smithi057.stderr:+ rados -p 319496fe-d53f-40fe-a120-83451e8717ac put obj3 /etc/passwd 2024-04-24T02:05:17.160 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.158+0000 7efc40430ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:17.165 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.164+0000 7efc40430ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:17.165 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.164+0000 7efc40430ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:17.166 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.165+0000 7efc40430ec0 1 Processor -- start 2024-04-24T02:05:17.166 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.165+0000 7efc40430ec0 1 -- start start 2024-04-24T02:05:17.168 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.167+0000 7efc40430ec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1523390 0x163b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.168 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.167+0000 7efc40430ec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x1488950 con 0x1523390 2024-04-24T02:05:17.168 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.167+0000 7efc337fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1523390 0x163b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:17.169 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.167+0000 7efc337fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1523390 0x163b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34122/0 (socket says 172.21.15.57:34122) 2024-04-24T02:05:17.169 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.167+0000 7efc337fe640 1 -- 172.21.15.57:0/3959344992 learned_addr learned my addr 172.21.15.57:0/3959344992 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:05:17.169 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.167+0000 7efc337fe640 1 -- 172.21.15.57:0/3959344992 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x14271e0 con 0x1523390 2024-04-24T02:05:17.169 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.167+0000 7efc337fe640 1 --2- 172.21.15.57:0/3959344992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1523390 0x163b4b0 crc :-1 s=READY pgs=12840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5454df35cec284b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.169 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.167+0000 7efc31ffb640 1 -- 172.21.15.57:0/3959344992 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efc2c032040 con 0x1523390 2024-04-24T02:05:17.169 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.167+0000 7efc31ffb640 1 -- 172.21.15.57:0/3959344992 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efc2c00a040 con 0x1523390 2024-04-24T02:05:17.169 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.167+0000 7efc31ffb640 1 -- 172.21.15.57:0/3959344992 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efc2c00a2e0 con 0x1523390 2024-04-24T02:05:17.170 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.168+0000 7efc40430ec0 1 -- 172.21.15.57:0/3959344992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1523390 msgr2=0x163b4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.170 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.168+0000 7efc40430ec0 1 --2- 172.21.15.57:0/3959344992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1523390 0x163b4b0 crc :-1 s=READY pgs=12840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.171 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.168+0000 7efc40430ec0 1 -- 172.21.15.57:0/3959344992 shutdown_connections 2024-04-24T02:05:17.171 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.168+0000 7efc40430ec0 1 --2- 172.21.15.57:0/3959344992 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1523390 0x163b4b0 unknown :-1 s=CLOSED pgs=12840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.171 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.168+0000 7efc40430ec0 1 -- 172.21.15.57:0/3959344992 >> 172.21.15.57:0/3959344992 conn(0x143f960 msgr2=0x15b5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:17.171 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.168+0000 7efc40430ec0 1 -- 172.21.15.57:0/3959344992 shutdown_connections 2024-04-24T02:05:17.171 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.168+0000 7efc40430ec0 1 -- 172.21.15.57:0/3959344992 wait complete. 2024-04-24T02:05:17.171 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.169+0000 7efc40430ec0 1 Processor -- start 2024-04-24T02:05:17.171 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.169+0000 7efc40430ec0 1 -- start start 2024-04-24T02:05:17.173 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.170+0000 7efc40430ec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1523390 0x151d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.173 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.170+0000 7efc40430ec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x14863d0 con 0x1523390 2024-04-24T02:05:17.173 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.170+0000 7efc337fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1523390 0x151d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:17.173 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.170+0000 7efc337fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1523390 0x151d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34126/0 (socket says 172.21.15.57:34126) 2024-04-24T02:05:17.173 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.170+0000 7efc337fe640 1 -- 172.21.15.57:0/2277469821 learned_addr learned my addr 172.21.15.57:0/2277469821 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:05:17.173 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.171+0000 7efc337fe640 1 -- 172.21.15.57:0/2277469821 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1419e30 con 0x1523390 2024-04-24T02:05:17.173 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.171+0000 7efc337fe640 1 --2- 172.21.15.57:0/2277469821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1523390 0x151d660 crc :-1 s=READY pgs=12841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.173 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.171+0000 7efc30ff9640 1 -- 172.21.15.57:0/2277469821 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efc2c02d570 con 0x1523390 2024-04-24T02:05:17.174 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.171+0000 7efc30ff9640 1 -- 172.21.15.57:0/2277469821 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7efc2c02d6d0 con 0x1523390 2024-04-24T02:05:17.174 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.171+0000 7efc40430ec0 1 -- 172.21.15.57:0/2277469821 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1419890 con 0x1523390 2024-04-24T02:05:17.174 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.171+0000 7efc30ff9640 1 -- 172.21.15.57:0/2277469821 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7efc2c02d970 con 0x1523390 2024-04-24T02:05:17.174 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.171+0000 7efc40430ec0 1 -- 172.21.15.57:0/2277469821 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x15af850 con 0x1523390 2024-04-24T02:05:17.174 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.172+0000 7efc30ff9640 1 -- 172.21.15.57:0/2277469821 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7efc2c02dad0 con 0x1523390 2024-04-24T02:05:17.175 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.172+0000 7efc30ff9640 1 --2- 172.21.15.57:0/2277469821 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7efc14037210 0x7efc14039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.175 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.172+0000 7efc30ff9640 1 -- 172.21.15.57:0/2277469821 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(688..688 src has 395..688) ==== 3791+0+0 (crc 0 0 0) 0x7efc2c032040 con 0x1523390 2024-04-24T02:05:17.175 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.172+0000 7efc40430ec0 1 --2- 172.21.15.57:0/2277469821 >> v2:172.21.15.57:6805/2600611357 conn(0x15b6010 0x151ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.175 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.172+0000 7efc40430ec0 1 -- 172.21.15.57:0/2277469821 --> v2:172.21.15.57:6805/2600611357 -- osd_op(unknown.0.0:1 200.1 200:8dd16f86:::obj3:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e688) -- 0x151c4f0 con 0x15b6010 2024-04-24T02:05:17.175 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.173+0000 7efc32ffd640 1 --2- 172.21.15.57:0/2277469821 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7efc14037210 0x7efc14039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:17.175 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.173+0000 7efc32ffd640 1 --2- 172.21.15.57:0/2277469821 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7efc14037210 0x7efc14039720 crc :-1 s=READY pgs=3924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.176 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.173+0000 7efc38d9c640 1 --2- 172.21.15.57:0/2277469821 >> v2:172.21.15.57:6805/2600611357 conn(0x15b6010 0x151ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T02:05:17.177 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.176+0000 7efc38d9c640 1 --2- 172.21.15.57:0/2277469821 >> v2:172.21.15.57:6805/2600611357 conn(0x15b6010 0x151ec80 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.384 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.382+0000 7efc38d9c640 1 -- 172.21.15.57:0/2277469821 <== osd.1 v2:172.21.15.57:6805/2600611357 1 ==== osd_op_reply(1 obj3 [writefull 0~11876] v688'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7efc2400a430 con 0x15b6010 2024-04-24T02:05:17.384 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.382+0000 7efc40430ec0 1 -- 172.21.15.57:0/2277469821 >> v2:172.21.15.57:6805/2600611357 conn(0x15b6010 msgr2=0x151ec80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.384 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.382+0000 7efc40430ec0 1 --2- 172.21.15.57:0/2277469821 >> v2:172.21.15.57:6805/2600611357 conn(0x15b6010 0x151ec80 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.384 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.382+0000 7efc40430ec0 1 -- 172.21.15.57:0/2277469821 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7efc14037210 msgr2=0x7efc14039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.384 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.382+0000 7efc40430ec0 1 --2- 172.21.15.57:0/2277469821 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7efc14037210 0x7efc14039720 crc :-1 s=READY pgs=3924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.385 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.382+0000 7efc40430ec0 1 -- 172.21.15.57:0/2277469821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1523390 msgr2=0x151d660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.385 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.382+0000 7efc40430ec0 1 --2- 172.21.15.57:0/2277469821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1523390 0x151d660 crc :-1 s=READY pgs=12841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.385 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.382+0000 7efc40430ec0 1 -- 172.21.15.57:0/2277469821 shutdown_connections 2024-04-24T02:05:17.385 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.382+0000 7efc40430ec0 1 --2- 172.21.15.57:0/2277469821 >> v2:172.21.15.57:6805/2600611357 conn(0x15b6010 0x151ec80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.385 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.382+0000 7efc40430ec0 1 --2- 172.21.15.57:0/2277469821 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7efc14037210 0x7efc14039720 unknown :-1 s=CLOSED pgs=3924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.385 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.382+0000 7efc40430ec0 1 --2- 172.21.15.57:0/2277469821 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1523390 0x151d660 unknown :-1 s=CLOSED pgs=12841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.385 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.382+0000 7efc40430ec0 1 -- 172.21.15.57:0/2277469821 >> 172.21.15.57:0/2277469821 conn(0x143f960 msgr2=0x15b4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:17.385 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.382+0000 7efc40430ec0 1 -- 172.21.15.57:0/2277469821 shutdown_connections 2024-04-24T02:05:17.385 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.382+0000 7efc40430ec0 1 -- 172.21.15.57:0/2277469821 wait complete. 2024-04-24T02:05:17.386 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in `seq 1 10` 2024-04-24T02:05:17.386 INFO:tasks.workunit.client.0.smithi057.stderr:+ rados -p 319496fe-d53f-40fe-a120-83451e8717ac put obj4 /etc/passwd 2024-04-24T02:05:17.422 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.421+0000 7f35f3c39ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:17.428 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.427+0000 7f35f3c39ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:17.428 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.427+0000 7f35f3c39ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:17.429 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.428+0000 7f35f3c39ec0 1 Processor -- start 2024-04-24T02:05:17.429 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.428+0000 7f35f3c39ec0 1 -- start start 2024-04-24T02:05:17.431 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.429+0000 7f35f3c39ec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1557260 0x1602ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.431 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.429+0000 7f35f3c39ec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x14d7950 con 0x1557260 2024-04-24T02:05:17.431 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.429+0000 7f35e6ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1557260 0x1602ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:17.431 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.429+0000 7f35e6ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1557260 0x1602ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34144/0 (socket says 172.21.15.57:34144) 2024-04-24T02:05:17.431 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.429+0000 7f35e6ffd640 1 -- 172.21.15.57:0/3926089521 learned_addr learned my addr 172.21.15.57:0/3926089521 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:05:17.432 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.430+0000 7f35e6ffd640 1 -- 172.21.15.57:0/3926089521 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x14761e0 con 0x1557260 2024-04-24T02:05:17.432 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.430+0000 7f35e6ffd640 1 --2- 172.21.15.57:0/3926089521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1557260 0x1602ec0 crc :-1 s=READY pgs=12844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c7e3113cfc00d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.432 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.430+0000 7f35e57fa640 1 -- 172.21.15.57:0/3926089521 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f35d8006380 con 0x1557260 2024-04-24T02:05:17.432 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.430+0000 7f35e57fa640 1 -- 172.21.15.57:0/3926089521 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f35d80064e0 con 0x1557260 2024-04-24T02:05:17.432 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.430+0000 7f35e57fa640 1 -- 172.21.15.57:0/3926089521 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f35d80067e0 con 0x1557260 2024-04-24T02:05:17.433 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.430+0000 7f35f3c39ec0 1 -- 172.21.15.57:0/3926089521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1557260 msgr2=0x1602ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.433 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.430+0000 7f35f3c39ec0 1 --2- 172.21.15.57:0/3926089521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1557260 0x1602ec0 crc :-1 s=READY pgs=12844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.433 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.430+0000 7f35f3c39ec0 1 -- 172.21.15.57:0/3926089521 shutdown_connections 2024-04-24T02:05:17.433 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.430+0000 7f35f3c39ec0 1 --2- 172.21.15.57:0/3926089521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1557260 0x1602ec0 unknown :-1 s=CLOSED pgs=12844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.433 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.430+0000 7f35f3c39ec0 1 -- 172.21.15.57:0/3926089521 >> 172.21.15.57:0/3926089521 conn(0x148e960 msgr2=0x1601590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:17.433 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.431+0000 7f35f3c39ec0 1 -- 172.21.15.57:0/3926089521 shutdown_connections 2024-04-24T02:05:17.433 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.431+0000 7f35f3c39ec0 1 -- 172.21.15.57:0/3926089521 wait complete. 2024-04-24T02:05:17.433 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.431+0000 7f35f3c39ec0 1 Processor -- start 2024-04-24T02:05:17.433 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.432+0000 7f35f3c39ec0 1 -- start start 2024-04-24T02:05:17.435 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.433+0000 7f35f3c39ec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1557260 0x1608ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.435 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.433+0000 7f35f3c39ec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x14d53d0 con 0x1557260 2024-04-24T02:05:17.435 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.433+0000 7f35e6ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1557260 0x1608ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:17.435 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.433+0000 7f35e6ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1557260 0x1608ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34156/0 (socket says 172.21.15.57:34156) 2024-04-24T02:05:17.435 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.433+0000 7f35e6ffd640 1 -- 172.21.15.57:0/365265776 learned_addr learned my addr 172.21.15.57:0/365265776 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:05:17.435 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.433+0000 7f35e6ffd640 1 -- 172.21.15.57:0/365265776 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1468e30 con 0x1557260 2024-04-24T02:05:17.435 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.434+0000 7f35e6ffd640 1 --2- 172.21.15.57:0/365265776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1557260 0x1608ce0 crc :-1 s=READY pgs=12845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.435 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.434+0000 7f35cffff640 1 -- 172.21.15.57:0/365265776 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f35d8006e90 con 0x1557260 2024-04-24T02:05:17.436 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.434+0000 7f35cffff640 1 -- 172.21.15.57:0/365265776 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f35d8035450 con 0x1557260 2024-04-24T02:05:17.436 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.434+0000 7f35f3c39ec0 1 -- 172.21.15.57:0/365265776 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1468890 con 0x1557260 2024-04-24T02:05:17.436 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.434+0000 7f35cffff640 1 -- 172.21.15.57:0/365265776 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f35d80356f0 con 0x1557260 2024-04-24T02:05:17.436 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.434+0000 7f35f3c39ec0 1 -- 172.21.15.57:0/365265776 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x15ed760 con 0x1557260 2024-04-24T02:05:17.438 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.435+0000 7f35cffff640 1 -- 172.21.15.57:0/365265776 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f35d8035850 con 0x1557260 2024-04-24T02:05:17.438 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.435+0000 7f35cffff640 1 --2- 172.21.15.57:0/365265776 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f35d4037210 0x7f35d4039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.438 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.435+0000 7f35cffff640 1 -- 172.21.15.57:0/365265776 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(688..688 src has 395..688) ==== 3791+0+0 (crc 0 0 0) 0x7f35d803b040 con 0x1557260 2024-04-24T02:05:17.438 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.435+0000 7f35f3c39ec0 1 --2- 172.21.15.57:0/365265776 >> v2:172.21.15.84:6808/91137974 conn(0x1557bb0 0x169bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.438 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.435+0000 7f35f3c39ec0 1 -- 172.21.15.57:0/365265776 --> v2:172.21.15.84:6808/91137974 -- osd_op(unknown.0.0:1 200.0 200:0ee9ae15:::obj4:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e688) -- 0x15ef700 con 0x1557bb0 2024-04-24T02:05:17.438 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.435+0000 7f35e67fc640 1 --2- 172.21.15.57:0/365265776 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f35d4037210 0x7f35d4039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:17.438 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.436+0000 7f35e67fc640 1 --2- 172.21.15.57:0/365265776 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f35d4037210 0x7f35d4039720 crc :-1 s=READY pgs=3925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.438 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.436+0000 7f35e77fe640 1 --2- 172.21.15.57:0/365265776 >> v2:172.21.15.84:6808/91137974 conn(0x1557bb0 0x169bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T02:05:17.441 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.440+0000 7f35e77fe640 1 --2- 172.21.15.57:0/365265776 >> v2:172.21.15.84:6808/91137974 conn(0x1557bb0 0x169bd30 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.453 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.450+0000 7f35e77fe640 1 -- 172.21.15.57:0/365265776 <== osd.3 v2:172.21.15.84:6808/91137974 1 ==== osd_op_reply(1 obj4 [writefull 0~11876] v688'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f35e000a430 con 0x1557bb0 2024-04-24T02:05:17.453 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.451+0000 7f35f3c39ec0 1 -- 172.21.15.57:0/365265776 >> v2:172.21.15.84:6808/91137974 conn(0x1557bb0 msgr2=0x169bd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.453 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.451+0000 7f35f3c39ec0 1 --2- 172.21.15.57:0/365265776 >> v2:172.21.15.84:6808/91137974 conn(0x1557bb0 0x169bd30 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.453 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.451+0000 7f35f3c39ec0 1 -- 172.21.15.57:0/365265776 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f35d4037210 msgr2=0x7f35d4039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.453 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.451+0000 7f35f3c39ec0 1 --2- 172.21.15.57:0/365265776 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f35d4037210 0x7f35d4039720 crc :-1 s=READY pgs=3925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.453 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.451+0000 7f35f3c39ec0 1 -- 172.21.15.57:0/365265776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1557260 msgr2=0x1608ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.453 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.451+0000 7f35f3c39ec0 1 --2- 172.21.15.57:0/365265776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1557260 0x1608ce0 crc :-1 s=READY pgs=12845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.453 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.451+0000 7f35f3c39ec0 1 -- 172.21.15.57:0/365265776 shutdown_connections 2024-04-24T02:05:17.453 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.451+0000 7f35f3c39ec0 1 --2- 172.21.15.57:0/365265776 >> v2:172.21.15.84:6808/91137974 conn(0x1557bb0 0x169bd30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.453 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.451+0000 7f35f3c39ec0 1 --2- 172.21.15.57:0/365265776 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f35d4037210 0x7f35d4039720 unknown :-1 s=CLOSED pgs=3925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.453 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.451+0000 7f35f3c39ec0 1 --2- 172.21.15.57:0/365265776 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1557260 0x1608ce0 unknown :-1 s=CLOSED pgs=12845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.454 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.451+0000 7f35f3c39ec0 1 -- 172.21.15.57:0/365265776 >> 172.21.15.57:0/365265776 conn(0x148e960 msgr2=0x156bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:17.454 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.451+0000 7f35f3c39ec0 1 -- 172.21.15.57:0/365265776 shutdown_connections 2024-04-24T02:05:17.454 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.451+0000 7f35f3c39ec0 1 -- 172.21.15.57:0/365265776 wait complete. 2024-04-24T02:05:17.454 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in `seq 1 10` 2024-04-24T02:05:17.454 INFO:tasks.workunit.client.0.smithi057.stderr:+ rados -p 319496fe-d53f-40fe-a120-83451e8717ac put obj5 /etc/passwd 2024-04-24T02:05:17.490 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.489+0000 7f50aaa79ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:17.496 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.495+0000 7f50aaa79ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:17.496 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.495+0000 7f50aaa79ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:17.497 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.496+0000 7f50aaa79ec0 1 Processor -- start 2024-04-24T02:05:17.497 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.496+0000 7f50aaa79ec0 1 -- start start 2024-04-24T02:05:17.500 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.497+0000 7f50aaa79ec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xa04540 0xa7f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.500 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.497+0000 7f50aaa79ec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x969950 con 0xa04540 2024-04-24T02:05:17.500 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.497+0000 7f50a2b9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xa04540 0xa7f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:17.500 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.497+0000 7f50a2b9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xa04540 0xa7f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34176/0 (socket says 172.21.15.57:34176) 2024-04-24T02:05:17.500 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.497+0000 7f50a2b9b640 1 -- 172.21.15.57:0/2035012346 learned_addr learned my addr 172.21.15.57:0/2035012346 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:05:17.500 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.497+0000 7f50a2b9b640 1 -- 172.21.15.57:0/2035012346 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x9081e0 con 0xa04540 2024-04-24T02:05:17.500 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.498+0000 7f50a2b9b640 1 --2- 172.21.15.57:0/2035012346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xa04540 0xa7f180 crc :-1 s=READY pgs=12848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80b09e331404234a server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.500 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.498+0000 7f50a1398640 1 -- 172.21.15.57:0/2035012346 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5094032040 con 0xa04540 2024-04-24T02:05:17.500 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.498+0000 7f50a1398640 1 -- 172.21.15.57:0/2035012346 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f509400a040 con 0xa04540 2024-04-24T02:05:17.501 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.498+0000 7f50a1398640 1 -- 172.21.15.57:0/2035012346 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f509400a2e0 con 0xa04540 2024-04-24T02:05:17.501 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.498+0000 7f50aaa79ec0 1 -- 172.21.15.57:0/2035012346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xa04540 msgr2=0xa7f180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.501 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.498+0000 7f50aaa79ec0 1 --2- 172.21.15.57:0/2035012346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xa04540 0xa7f180 crc :-1 s=READY pgs=12848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.501 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.498+0000 7f50aaa79ec0 1 -- 172.21.15.57:0/2035012346 shutdown_connections 2024-04-24T02:05:17.501 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.498+0000 7f50aaa79ec0 1 --2- 172.21.15.57:0/2035012346 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xa04540 0xa7f180 unknown :-1 s=CLOSED pgs=12848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.501 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.498+0000 7f50aaa79ec0 1 -- 172.21.15.57:0/2035012346 >> 172.21.15.57:0/2035012346 conn(0x920960 msgr2=0x9fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:17.501 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.498+0000 7f50aaa79ec0 1 -- 172.21.15.57:0/2035012346 shutdown_connections 2024-04-24T02:05:17.501 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.498+0000 7f50aaa79ec0 1 -- 172.21.15.57:0/2035012346 wait complete. 2024-04-24T02:05:17.502 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.499+0000 7f50aaa79ec0 1 Processor -- start 2024-04-24T02:05:17.502 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.499+0000 7f50aaa79ec0 1 -- start start 2024-04-24T02:05:17.502 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.501+0000 7f50aaa79ec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xa04540 0xb2b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.502 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.501+0000 7f50aaa79ec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x9673d0 con 0xa04540 2024-04-24T02:05:17.503 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.501+0000 7f50a2b9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xa04540 0xb2b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:17.503 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.501+0000 7f50a2b9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xa04540 0xb2b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34190/0 (socket says 172.21.15.57:34190) 2024-04-24T02:05:17.503 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.501+0000 7f50a2b9b640 1 -- 172.21.15.57:0/3992150184 learned_addr learned my addr 172.21.15.57:0/3992150184 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:05:17.503 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.501+0000 7f50a2b9b640 1 -- 172.21.15.57:0/3992150184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x8fae30 con 0xa04540 2024-04-24T02:05:17.503 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.501+0000 7f50a2b9b640 1 --2- 172.21.15.57:0/3992150184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xa04540 0xb2b6e0 crc :-1 s=READY pgs=12849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.504 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.502+0000 7f509b7fe640 1 -- 172.21.15.57:0/3992150184 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f509402d650 con 0xa04540 2024-04-24T02:05:17.504 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.502+0000 7f509b7fe640 1 -- 172.21.15.57:0/3992150184 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f509402d7b0 con 0xa04540 2024-04-24T02:05:17.504 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.502+0000 7f50aaa79ec0 1 -- 172.21.15.57:0/3992150184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x8fa890 con 0xa04540 2024-04-24T02:05:17.505 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.502+0000 7f509b7fe640 1 -- 172.21.15.57:0/3992150184 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f509402da50 con 0xa04540 2024-04-24T02:05:17.505 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.502+0000 7f50aaa79ec0 1 -- 172.21.15.57:0/3992150184 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0xa83790 con 0xa04540 2024-04-24T02:05:17.505 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.503+0000 7f509b7fe640 1 -- 172.21.15.57:0/3992150184 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f509402dc00 con 0xa04540 2024-04-24T02:05:17.505 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.503+0000 7f509b7fe640 1 --2- 172.21.15.57:0/3992150184 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f5088037210 0x7f5088039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.505 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.503+0000 7f509b7fe640 1 -- 172.21.15.57:0/3992150184 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(688..688 src has 395..688) ==== 3791+0+0 (crc 0 0 0) 0x7f5094032040 con 0xa04540 2024-04-24T02:05:17.505 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.503+0000 7f50a239a640 1 --2- 172.21.15.57:0/3992150184 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f5088037210 0x7f5088039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:17.505 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.503+0000 7f50aaa79ec0 1 --2- 172.21.15.57:0/3992150184 >> v2:172.21.15.84:6808/91137974 conn(0xa96ab0 0xa823e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.505 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.503+0000 7f50aaa79ec0 1 -- 172.21.15.57:0/3992150184 --> v2:172.21.15.84:6808/91137974 -- osd_op(unknown.0.0:1 200.3 200:c52c9666:::obj5:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e688) -- 0xa85780 con 0xa96ab0 2024-04-24T02:05:17.506 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.504+0000 7f50a239a640 1 --2- 172.21.15.57:0/3992150184 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f5088037210 0x7f5088039720 crc :-1 s=READY pgs=3926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.506 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.504+0000 7f50a339c640 1 --2- 172.21.15.57:0/3992150184 >> v2:172.21.15.84:6808/91137974 conn(0xa96ab0 0xa823e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T02:05:17.508 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.506+0000 7f50a339c640 1 --2- 172.21.15.57:0/3992150184 >> v2:172.21.15.84:6808/91137974 conn(0xa96ab0 0xa823e0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.518 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.516+0000 7f50a339c640 1 -- 172.21.15.57:0/3992150184 <== osd.3 v2:172.21.15.84:6808/91137974 1 ==== osd_op_reply(1 obj5 [writefull 0~11876] v688'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f508c00a430 con 0xa96ab0 2024-04-24T02:05:17.518 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.516+0000 7f50aaa79ec0 1 -- 172.21.15.57:0/3992150184 >> v2:172.21.15.84:6808/91137974 conn(0xa96ab0 msgr2=0xa823e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.518 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.516+0000 7f50aaa79ec0 1 --2- 172.21.15.57:0/3992150184 >> v2:172.21.15.84:6808/91137974 conn(0xa96ab0 0xa823e0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.518 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.516+0000 7f50aaa79ec0 1 -- 172.21.15.57:0/3992150184 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f5088037210 msgr2=0x7f5088039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.519 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.516+0000 7f50aaa79ec0 1 --2- 172.21.15.57:0/3992150184 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f5088037210 0x7f5088039720 crc :-1 s=READY pgs=3926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.519 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.516+0000 7f50aaa79ec0 1 -- 172.21.15.57:0/3992150184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xa04540 msgr2=0xb2b6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.519 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.516+0000 7f50aaa79ec0 1 --2- 172.21.15.57:0/3992150184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xa04540 0xb2b6e0 crc :-1 s=READY pgs=12849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.519 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.517+0000 7f50aaa79ec0 1 -- 172.21.15.57:0/3992150184 shutdown_connections 2024-04-24T02:05:17.519 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.517+0000 7f50aaa79ec0 1 --2- 172.21.15.57:0/3992150184 >> v2:172.21.15.84:6808/91137974 conn(0xa96ab0 0xa823e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.519 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.517+0000 7f50aaa79ec0 1 --2- 172.21.15.57:0/3992150184 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f5088037210 0x7f5088039720 unknown :-1 s=CLOSED pgs=3926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.519 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.517+0000 7f50aaa79ec0 1 --2- 172.21.15.57:0/3992150184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xa04540 0xb2b6e0 unknown :-1 s=CLOSED pgs=12849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.519 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.517+0000 7f50aaa79ec0 1 -- 172.21.15.57:0/3992150184 >> 172.21.15.57:0/3992150184 conn(0x920960 msgr2=0x9fdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:17.519 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.517+0000 7f50aaa79ec0 1 -- 172.21.15.57:0/3992150184 shutdown_connections 2024-04-24T02:05:17.519 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.517+0000 7f50aaa79ec0 1 -- 172.21.15.57:0/3992150184 wait complete. 2024-04-24T02:05:17.520 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in `seq 1 10` 2024-04-24T02:05:17.520 INFO:tasks.workunit.client.0.smithi057.stderr:+ rados -p 319496fe-d53f-40fe-a120-83451e8717ac put obj6 /etc/passwd 2024-04-24T02:05:17.557 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.555+0000 7f8f94edeec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:17.562 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.561+0000 7f8f94edeec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:17.563 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.561+0000 7f8f94edeec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:17.563 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.562+0000 7f8f94edeec0 1 Processor -- start 2024-04-24T02:05:17.563 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.562+0000 7f8f94edeec0 1 -- start start 2024-04-24T02:05:17.566 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.564+0000 7f8f94edeec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x20b4540 0x212f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.566 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.564+0000 7f8f94edeec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x2019950 con 0x20b4540 2024-04-24T02:05:17.566 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.564+0000 7f8f8d39b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x20b4540 0x212f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:17.566 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.564+0000 7f8f8d39b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x20b4540 0x212f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34218/0 (socket says 172.21.15.57:34218) 2024-04-24T02:05:17.566 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.564+0000 7f8f8d39b640 1 -- 172.21.15.57:0/3464453939 learned_addr learned my addr 172.21.15.57:0/3464453939 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:05:17.566 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.564+0000 7f8f8d39b640 1 -- 172.21.15.57:0/3464453939 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1fb81e0 con 0x20b4540 2024-04-24T02:05:17.566 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.564+0000 7f8f8d39b640 1 --2- 172.21.15.57:0/3464453939 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x20b4540 0x212f180 crc :-1 s=READY pgs=12852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fbb7b94bc6f6aaf server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.566 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.565+0000 7f8f86ffd640 1 -- 172.21.15.57:0/3464453939 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8f78032040 con 0x20b4540 2024-04-24T02:05:17.566 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.565+0000 7f8f86ffd640 1 -- 172.21.15.57:0/3464453939 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8f7800a040 con 0x20b4540 2024-04-24T02:05:17.566 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.565+0000 7f8f86ffd640 1 -- 172.21.15.57:0/3464453939 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8f7800a2e0 con 0x20b4540 2024-04-24T02:05:17.568 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.565+0000 7f8f94edeec0 1 -- 172.21.15.57:0/3464453939 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x20b4540 msgr2=0x212f180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.568 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.565+0000 7f8f94edeec0 1 --2- 172.21.15.57:0/3464453939 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x20b4540 0x212f180 crc :-1 s=READY pgs=12852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.568 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.565+0000 7f8f94edeec0 1 -- 172.21.15.57:0/3464453939 shutdown_connections 2024-04-24T02:05:17.568 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.565+0000 7f8f94edeec0 1 --2- 172.21.15.57:0/3464453939 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x20b4540 0x212f180 unknown :-1 s=CLOSED pgs=12852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.568 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.565+0000 7f8f94edeec0 1 -- 172.21.15.57:0/3464453939 >> 172.21.15.57:0/3464453939 conn(0x1fd0960 msgr2=0x20adda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:17.568 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.565+0000 7f8f94edeec0 1 -- 172.21.15.57:0/3464453939 shutdown_connections 2024-04-24T02:05:17.568 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.565+0000 7f8f94edeec0 1 -- 172.21.15.57:0/3464453939 wait complete. 2024-04-24T02:05:17.568 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.566+0000 7f8f94edeec0 1 Processor -- start 2024-04-24T02:05:17.568 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.566+0000 7f8f94edeec0 1 -- start start 2024-04-24T02:05:17.570 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.568+0000 7f8f94edeec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x20b4540 0x21db6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.570 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.568+0000 7f8f94edeec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x20173d0 con 0x20b4540 2024-04-24T02:05:17.570 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.568+0000 7f8f8d39b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x20b4540 0x21db6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:17.570 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.568+0000 7f8f8d39b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x20b4540 0x21db6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34228/0 (socket says 172.21.15.57:34228) 2024-04-24T02:05:17.570 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.568+0000 7f8f8d39b640 1 -- 172.21.15.57:0/1059497924 learned_addr learned my addr 172.21.15.57:0/1059497924 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:05:17.570 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.568+0000 7f8f8d39b640 1 -- 172.21.15.57:0/1059497924 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1faae30 con 0x20b4540 2024-04-24T02:05:17.570 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.568+0000 7f8f8d39b640 1 --2- 172.21.15.57:0/1059497924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x20b4540 0x21db6e0 crc :-1 s=READY pgs=12853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.570 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.568+0000 7f8f85ffb640 1 -- 172.21.15.57:0/1059497924 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8f7802d650 con 0x20b4540 2024-04-24T02:05:17.570 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.568+0000 7f8f85ffb640 1 -- 172.21.15.57:0/1059497924 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8f7802d7b0 con 0x20b4540 2024-04-24T02:05:17.570 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.568+0000 7f8f94edeec0 1 -- 172.21.15.57:0/1059497924 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1faa890 con 0x20b4540 2024-04-24T02:05:17.570 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.568+0000 7f8f85ffb640 1 -- 172.21.15.57:0/1059497924 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8f7802da50 con 0x20b4540 2024-04-24T02:05:17.571 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.568+0000 7f8f94edeec0 1 -- 172.21.15.57:0/1059497924 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x2133790 con 0x20b4540 2024-04-24T02:05:17.572 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.569+0000 7f8f85ffb640 1 -- 172.21.15.57:0/1059497924 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f8f7802dc00 con 0x20b4540 2024-04-24T02:05:17.572 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.570+0000 7f8f85ffb640 1 --2- 172.21.15.57:0/1059497924 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f8f74037210 0x7f8f74039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.572 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.570+0000 7f8f85ffb640 1 -- 172.21.15.57:0/1059497924 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(688..688 src has 395..688) ==== 3791+0+0 (crc 0 0 0) 0x7f8f78032040 con 0x20b4540 2024-04-24T02:05:17.572 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.570+0000 7f8f94edeec0 1 --2- 172.21.15.57:0/1059497924 >> v2:172.21.15.57:6805/2600611357 conn(0x2146ab0 0x21323e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.572 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.570+0000 7f8f94edeec0 1 -- 172.21.15.57:0/1059497924 --> v2:172.21.15.57:6805/2600611357 -- osd_op(unknown.0.0:1 200.4 200:233a42c1:::obj6:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e688) -- 0x2135780 con 0x2146ab0 2024-04-24T02:05:17.572 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.570+0000 7f8f8cb9a640 1 --2- 172.21.15.57:0/1059497924 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f8f74037210 0x7f8f74039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:17.572 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.570+0000 7f8f8cb9a640 1 --2- 172.21.15.57:0/1059497924 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f8f74037210 0x7f8f74039720 crc :-1 s=READY pgs=3927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.572 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.571+0000 7f8f8db9c640 1 --2- 172.21.15.57:0/1059497924 >> v2:172.21.15.57:6805/2600611357 conn(0x2146ab0 0x21323e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T02:05:17.575 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.574+0000 7f8f8db9c640 1 --2- 172.21.15.57:0/1059497924 >> v2:172.21.15.57:6805/2600611357 conn(0x2146ab0 0x21323e0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.587 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.585+0000 7f8f8db9c640 1 -- 172.21.15.57:0/1059497924 <== osd.1 v2:172.21.15.57:6805/2600611357 1 ==== osd_op_reply(1 obj6 [writefull 0~11876] v688'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f8f8000a430 con 0x2146ab0 2024-04-24T02:05:17.588 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.586+0000 7f8f94edeec0 1 -- 172.21.15.57:0/1059497924 >> v2:172.21.15.57:6805/2600611357 conn(0x2146ab0 msgr2=0x21323e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.588 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.586+0000 7f8f94edeec0 1 --2- 172.21.15.57:0/1059497924 >> v2:172.21.15.57:6805/2600611357 conn(0x2146ab0 0x21323e0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.588 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.586+0000 7f8f94edeec0 1 -- 172.21.15.57:0/1059497924 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f8f74037210 msgr2=0x7f8f74039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.588 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.586+0000 7f8f94edeec0 1 --2- 172.21.15.57:0/1059497924 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f8f74037210 0x7f8f74039720 crc :-1 s=READY pgs=3927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.588 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.586+0000 7f8f94edeec0 1 -- 172.21.15.57:0/1059497924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x20b4540 msgr2=0x21db6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.588 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.586+0000 7f8f94edeec0 1 --2- 172.21.15.57:0/1059497924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x20b4540 0x21db6e0 crc :-1 s=READY pgs=12853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.588 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.586+0000 7f8f94edeec0 1 -- 172.21.15.57:0/1059497924 shutdown_connections 2024-04-24T02:05:17.588 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.586+0000 7f8f94edeec0 1 --2- 172.21.15.57:0/1059497924 >> v2:172.21.15.57:6805/2600611357 conn(0x2146ab0 0x21323e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.588 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.586+0000 7f8f94edeec0 1 --2- 172.21.15.57:0/1059497924 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f8f74037210 0x7f8f74039720 unknown :-1 s=CLOSED pgs=3927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.588 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.586+0000 7f8f94edeec0 1 --2- 172.21.15.57:0/1059497924 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x20b4540 0x21db6e0 unknown :-1 s=CLOSED pgs=12853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.589 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.586+0000 7f8f94edeec0 1 -- 172.21.15.57:0/1059497924 >> 172.21.15.57:0/1059497924 conn(0x1fd0960 msgr2=0x20adda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:17.589 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.586+0000 7f8f94edeec0 1 -- 172.21.15.57:0/1059497924 shutdown_connections 2024-04-24T02:05:17.589 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.586+0000 7f8f94edeec0 1 -- 172.21.15.57:0/1059497924 wait complete. 2024-04-24T02:05:17.589 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in `seq 1 10` 2024-04-24T02:05:17.589 INFO:tasks.workunit.client.0.smithi057.stderr:+ rados -p 319496fe-d53f-40fe-a120-83451e8717ac put obj7 /etc/passwd 2024-04-24T02:05:17.626 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.625+0000 7fbdb20f0ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:17.632 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.630+0000 7fbdb20f0ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:17.632 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.631+0000 7fbdb20f0ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:17.632 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.631+0000 7fbdb20f0ec0 1 Processor -- start 2024-04-24T02:05:17.633 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.632+0000 7fbdb20f0ec0 1 -- start start 2024-04-24T02:05:17.635 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.633+0000 7fbdb20f0ec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1ec6540 0x1f41180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.635 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.633+0000 7fbdb20f0ec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x1e2b950 con 0x1ec6540 2024-04-24T02:05:17.635 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.633+0000 7fbdaa59b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1ec6540 0x1f41180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:17.635 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.633+0000 7fbdaa59b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1ec6540 0x1f41180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34246/0 (socket says 172.21.15.57:34246) 2024-04-24T02:05:17.635 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.633+0000 7fbdaa59b640 1 -- 172.21.15.57:0/1246400966 learned_addr learned my addr 172.21.15.57:0/1246400966 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:05:17.635 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.633+0000 7fbdaa59b640 1 -- 172.21.15.57:0/1246400966 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1dca1e0 con 0x1ec6540 2024-04-24T02:05:17.635 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.634+0000 7fbdaa59b640 1 --2- 172.21.15.57:0/1246400966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1ec6540 0x1f41180 crc :-1 s=READY pgs=12856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b47b5ab74b3e23 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.635 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.634+0000 7fbda8d98640 1 -- 172.21.15.57:0/1246400966 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbd9c036040 con 0x1ec6540 2024-04-24T02:05:17.635 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.634+0000 7fbda8d98640 1 -- 172.21.15.57:0/1246400966 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbd9c00a040 con 0x1ec6540 2024-04-24T02:05:17.635 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.634+0000 7fbda8d98640 1 -- 172.21.15.57:0/1246400966 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbd9c00a2e0 con 0x1ec6540 2024-04-24T02:05:17.636 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.634+0000 7fbdb20f0ec0 1 -- 172.21.15.57:0/1246400966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1ec6540 msgr2=0x1f41180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.636 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.634+0000 7fbdb20f0ec0 1 --2- 172.21.15.57:0/1246400966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1ec6540 0x1f41180 crc :-1 s=READY pgs=12856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.637 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.634+0000 7fbdb20f0ec0 1 -- 172.21.15.57:0/1246400966 shutdown_connections 2024-04-24T02:05:17.637 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.634+0000 7fbdb20f0ec0 1 --2- 172.21.15.57:0/1246400966 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1ec6540 0x1f41180 unknown :-1 s=CLOSED pgs=12856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.637 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.634+0000 7fbdb20f0ec0 1 -- 172.21.15.57:0/1246400966 >> 172.21.15.57:0/1246400966 conn(0x1de2960 msgr2=0x1ebfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:17.637 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.634+0000 7fbdb20f0ec0 1 -- 172.21.15.57:0/1246400966 shutdown_connections 2024-04-24T02:05:17.637 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.634+0000 7fbdb20f0ec0 1 -- 172.21.15.57:0/1246400966 wait complete. 2024-04-24T02:05:17.637 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.635+0000 7fbdb20f0ec0 1 Processor -- start 2024-04-24T02:05:17.637 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.635+0000 7fbdb20f0ec0 1 -- start start 2024-04-24T02:05:17.639 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.637+0000 7fbdb20f0ec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1ec6540 0x1fed7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.639 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.637+0000 7fbdb20f0ec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x1e293d0 con 0x1ec6540 2024-04-24T02:05:17.639 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.637+0000 7fbdaa59b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1ec6540 0x1fed7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:17.639 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.637+0000 7fbdaa59b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1ec6540 0x1fed7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34258/0 (socket says 172.21.15.57:34258) 2024-04-24T02:05:17.639 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.637+0000 7fbdaa59b640 1 -- 172.21.15.57:0/2549003203 learned_addr learned my addr 172.21.15.57:0/2549003203 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:05:17.639 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.637+0000 7fbdaa59b640 1 -- 172.21.15.57:0/2549003203 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1dbce30 con 0x1ec6540 2024-04-24T02:05:17.639 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.638+0000 7fbdaa59b640 1 --2- 172.21.15.57:0/2549003203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1ec6540 0x1fed7c0 crc :-1 s=READY pgs=12857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.640 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.638+0000 7fbda2ffd640 1 -- 172.21.15.57:0/2549003203 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbd9c036040 con 0x1ec6540 2024-04-24T02:05:17.640 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.638+0000 7fbda2ffd640 1 -- 172.21.15.57:0/2549003203 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbd9c037040 con 0x1ec6540 2024-04-24T02:05:17.640 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.638+0000 7fbdb20f0ec0 1 -- 172.21.15.57:0/2549003203 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1dbc890 con 0x1ec6540 2024-04-24T02:05:17.640 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.638+0000 7fbda2ffd640 1 -- 172.21.15.57:0/2549003203 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbd9c009670 con 0x1ec6540 2024-04-24T02:05:17.640 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.638+0000 7fbdb20f0ec0 1 -- 172.21.15.57:0/2549003203 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1f45930 con 0x1ec6540 2024-04-24T02:05:17.641 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.639+0000 7fbda2ffd640 1 -- 172.21.15.57:0/2549003203 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fbd9c009820 con 0x1ec6540 2024-04-24T02:05:17.641 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.639+0000 7fbda2ffd640 1 --2- 172.21.15.57:0/2549003203 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fbd84037210 0x7fbd84039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.641 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.639+0000 7fbda2ffd640 1 -- 172.21.15.57:0/2549003203 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(688..688 src has 395..688) ==== 3791+0+0 (crc 0 0 0) 0x7fbd9c06b7b0 con 0x1ec6540 2024-04-24T02:05:17.641 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.639+0000 7fbdb20f0ec0 1 --2- 172.21.15.57:0/2549003203 >> v2:172.21.15.57:6801/2208289758 conn(0x1f58ab0 0x1f44400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.641 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.639+0000 7fbda9d9a640 1 --2- 172.21.15.57:0/2549003203 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fbd84037210 0x7fbd84039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:17.642 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.639+0000 7fbdb20f0ec0 1 -- 172.21.15.57:0/2549003203 --> v2:172.21.15.57:6801/2208289758 -- osd_op(unknown.0.0:1 200.9 200:9a09113a:::obj7:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e688) -- 0x1f47e50 con 0x1f58ab0 2024-04-24T02:05:17.642 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.640+0000 7fbda9d9a640 1 --2- 172.21.15.57:0/2549003203 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fbd84037210 0x7fbd84039720 crc :-1 s=READY pgs=3928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.642 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.640+0000 7fbdaad9c640 1 --2- 172.21.15.57:0/2549003203 >> v2:172.21.15.57:6801/2208289758 conn(0x1f58ab0 0x1f44400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T02:05:17.645 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.644+0000 7fbdaad9c640 1 --2- 172.21.15.57:0/2549003203 >> v2:172.21.15.57:6801/2208289758 conn(0x1f58ab0 0x1f44400 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.866 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.864+0000 7fbdaad9c640 1 -- 172.21.15.57:0/2549003203 <== osd.0 v2:172.21.15.57:6801/2208289758 1 ==== osd_op_reply(1 obj7 [writefull 0~11876] v688'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fbd9400a430 con 0x1f58ab0 2024-04-24T02:05:17.866 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.864+0000 7fbdb20f0ec0 1 -- 172.21.15.57:0/2549003203 >> v2:172.21.15.57:6801/2208289758 conn(0x1f58ab0 msgr2=0x1f44400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.867 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.864+0000 7fbdb20f0ec0 1 --2- 172.21.15.57:0/2549003203 >> v2:172.21.15.57:6801/2208289758 conn(0x1f58ab0 0x1f44400 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.867 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.864+0000 7fbdb20f0ec0 1 -- 172.21.15.57:0/2549003203 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fbd84037210 msgr2=0x7fbd84039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.867 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.864+0000 7fbdb20f0ec0 1 --2- 172.21.15.57:0/2549003203 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fbd84037210 0x7fbd84039720 crc :-1 s=READY pgs=3928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.867 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.864+0000 7fbdb20f0ec0 1 -- 172.21.15.57:0/2549003203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1ec6540 msgr2=0x1fed7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.867 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.864+0000 7fbdb20f0ec0 1 --2- 172.21.15.57:0/2549003203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1ec6540 0x1fed7c0 crc :-1 s=READY pgs=12857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.867 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.864+0000 7fbdb20f0ec0 1 -- 172.21.15.57:0/2549003203 shutdown_connections 2024-04-24T02:05:17.867 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.864+0000 7fbdb20f0ec0 1 --2- 172.21.15.57:0/2549003203 >> v2:172.21.15.57:6801/2208289758 conn(0x1f58ab0 0x1f44400 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.867 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.865+0000 7fbdb20f0ec0 1 --2- 172.21.15.57:0/2549003203 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fbd84037210 0x7fbd84039720 unknown :-1 s=CLOSED pgs=3928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.867 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.865+0000 7fbdb20f0ec0 1 --2- 172.21.15.57:0/2549003203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1ec6540 0x1fed7c0 unknown :-1 s=CLOSED pgs=12857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.867 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.865+0000 7fbdb20f0ec0 1 -- 172.21.15.57:0/2549003203 >> 172.21.15.57:0/2549003203 conn(0x1de2960 msgr2=0x1ebfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:17.867 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.865+0000 7fbdb20f0ec0 1 -- 172.21.15.57:0/2549003203 shutdown_connections 2024-04-24T02:05:17.867 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.865+0000 7fbdb20f0ec0 1 -- 172.21.15.57:0/2549003203 wait complete. 2024-04-24T02:05:17.868 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in `seq 1 10` 2024-04-24T02:05:17.868 INFO:tasks.workunit.client.0.smithi057.stderr:+ rados -p 319496fe-d53f-40fe-a120-83451e8717ac put obj8 /etc/passwd 2024-04-24T02:05:17.905 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.904+0000 7f2dd7a4aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:17.910 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.909+0000 7f2dd7a4aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:17.911 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.910+0000 7f2dd7a4aec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:17.911 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.910+0000 7f2dd7a4aec0 1 Processor -- start 2024-04-24T02:05:17.912 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.911+0000 7f2dd7a4aec0 1 -- start start 2024-04-24T02:05:17.914 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.912+0000 7f2dd7a4aec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a09540 0x1a84180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.915 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.912+0000 7f2dd7a4aec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x196e950 con 0x1a09540 2024-04-24T02:05:17.915 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.912+0000 7f2dcaffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a09540 0x1a84180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:17.915 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.912+0000 7f2dcaffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a09540 0x1a84180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34276/0 (socket says 172.21.15.57:34276) 2024-04-24T02:05:17.915 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.912+0000 7f2dcaffd640 1 -- 172.21.15.57:0/1291378340 learned_addr learned my addr 172.21.15.57:0/1291378340 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:05:17.915 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.912+0000 7f2dcaffd640 1 -- 172.21.15.57:0/1291378340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x190d1e0 con 0x1a09540 2024-04-24T02:05:17.915 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.912+0000 7f2dcaffd640 1 --2- 172.21.15.57:0/1291378340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a09540 0x1a84180 crc :-1 s=READY pgs=12860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd79ac1e28427ded server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.915 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.913+0000 7f2dc97fa640 1 -- 172.21.15.57:0/1291378340 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2dbc032040 con 0x1a09540 2024-04-24T02:05:17.915 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.913+0000 7f2dc97fa640 1 -- 172.21.15.57:0/1291378340 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2dbc00a040 con 0x1a09540 2024-04-24T02:05:17.915 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.913+0000 7f2dc97fa640 1 -- 172.21.15.57:0/1291378340 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2dbc00a2e0 con 0x1a09540 2024-04-24T02:05:17.915 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.913+0000 7f2dd7a4aec0 1 -- 172.21.15.57:0/1291378340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a09540 msgr2=0x1a84180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.915 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.913+0000 7f2dd7a4aec0 1 --2- 172.21.15.57:0/1291378340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a09540 0x1a84180 crc :-1 s=READY pgs=12860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.915 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.913+0000 7f2dd7a4aec0 1 -- 172.21.15.57:0/1291378340 shutdown_connections 2024-04-24T02:05:17.915 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.913+0000 7f2dd7a4aec0 1 --2- 172.21.15.57:0/1291378340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a09540 0x1a84180 unknown :-1 s=CLOSED pgs=12860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.916 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.913+0000 7f2dd7a4aec0 1 -- 172.21.15.57:0/1291378340 >> 172.21.15.57:0/1291378340 conn(0x1925960 msgr2=0x1a02da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:17.916 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.913+0000 7f2dd7a4aec0 1 -- 172.21.15.57:0/1291378340 shutdown_connections 2024-04-24T02:05:17.916 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.913+0000 7f2dd7a4aec0 1 -- 172.21.15.57:0/1291378340 wait complete. 2024-04-24T02:05:17.916 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.914+0000 7f2dd7a4aec0 1 Processor -- start 2024-04-24T02:05:17.916 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.914+0000 7f2dd7a4aec0 1 -- start start 2024-04-24T02:05:17.918 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.916+0000 7f2dd7a4aec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a09540 0x1b306e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.918 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.916+0000 7f2dd7a4aec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x196c3d0 con 0x1a09540 2024-04-24T02:05:17.918 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.916+0000 7f2dcaffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a09540 0x1b306e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:17.918 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.916+0000 7f2dcaffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a09540 0x1b306e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34278/0 (socket says 172.21.15.57:34278) 2024-04-24T02:05:17.918 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.916+0000 7f2dcaffd640 1 -- 172.21.15.57:0/1267398698 learned_addr learned my addr 172.21.15.57:0/1267398698 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:05:17.918 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.916+0000 7f2dcaffd640 1 -- 172.21.15.57:0/1267398698 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x18ffe30 con 0x1a09540 2024-04-24T02:05:17.918 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.916+0000 7f2dcaffd640 1 --2- 172.21.15.57:0/1267398698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a09540 0x1b306e0 crc :-1 s=READY pgs=12861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.918 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.916+0000 7f2db3fff640 1 -- 172.21.15.57:0/1267398698 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2dbc02d650 con 0x1a09540 2024-04-24T02:05:17.918 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.917+0000 7f2db3fff640 1 -- 172.21.15.57:0/1267398698 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2dbc02d7b0 con 0x1a09540 2024-04-24T02:05:17.918 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.917+0000 7f2db3fff640 1 -- 172.21.15.57:0/1267398698 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2dbc02da50 con 0x1a09540 2024-04-24T02:05:17.918 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.917+0000 7f2dd7a4aec0 1 -- 172.21.15.57:0/1267398698 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x18ff890 con 0x1a09540 2024-04-24T02:05:17.918 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.917+0000 7f2dd7a4aec0 1 -- 172.21.15.57:0/1267398698 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1a88790 con 0x1a09540 2024-04-24T02:05:17.920 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.918+0000 7f2db3fff640 1 -- 172.21.15.57:0/1267398698 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f2dbc02dc00 con 0x1a09540 2024-04-24T02:05:17.920 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.918+0000 7f2db3fff640 1 --2- 172.21.15.57:0/1267398698 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f2db8037210 0x7f2db8039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.920 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.918+0000 7f2db3fff640 1 -- 172.21.15.57:0/1267398698 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(688..688 src has 395..688) ==== 3791+0+0 (crc 0 0 0) 0x7f2dbc032040 con 0x1a09540 2024-04-24T02:05:17.920 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.918+0000 7f2dd7a4aec0 1 --2- 172.21.15.57:0/1267398698 >> v2:172.21.15.57:6801/2208289758 conn(0x1a9bab0 0x1a873e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.920 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.918+0000 7f2dd7a4aec0 1 -- 172.21.15.57:0/1267398698 --> v2:172.21.15.57:6801/2208289758 -- osd_op(unknown.0.0:1 200.5 200:a557efb1:::obj8:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e688) -- 0x1a8a780 con 0x1a9bab0 2024-04-24T02:05:17.920 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.918+0000 7f2dca7fc640 1 --2- 172.21.15.57:0/1267398698 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f2db8037210 0x7f2db8039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:17.920 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.919+0000 7f2dcb7fe640 1 --2- 172.21.15.57:0/1267398698 >> v2:172.21.15.57:6801/2208289758 conn(0x1a9bab0 0x1a873e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T02:05:17.920 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.919+0000 7f2dca7fc640 1 --2- 172.21.15.57:0/1267398698 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f2db8037210 0x7f2db8039720 crc :-1 s=READY pgs=3929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.922 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.921+0000 7f2dcb7fe640 1 --2- 172.21.15.57:0/1267398698 >> v2:172.21.15.57:6801/2208289758 conn(0x1a9bab0 0x1a873e0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.933 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.932+0000 7f2dcb7fe640 1 -- 172.21.15.57:0/1267398698 <== osd.0 v2:172.21.15.57:6801/2208289758 1 ==== osd_op_reply(1 obj8 [writefull 0~11876] v688'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f2dc400a430 con 0x1a9bab0 2024-04-24T02:05:17.933 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.932+0000 7f2dd7a4aec0 1 -- 172.21.15.57:0/1267398698 >> v2:172.21.15.57:6801/2208289758 conn(0x1a9bab0 msgr2=0x1a873e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.934 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.932+0000 7f2dd7a4aec0 1 --2- 172.21.15.57:0/1267398698 >> v2:172.21.15.57:6801/2208289758 conn(0x1a9bab0 0x1a873e0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.934 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.932+0000 7f2dd7a4aec0 1 -- 172.21.15.57:0/1267398698 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f2db8037210 msgr2=0x7f2db8039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.934 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.932+0000 7f2dd7a4aec0 1 --2- 172.21.15.57:0/1267398698 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f2db8037210 0x7f2db8039720 crc :-1 s=READY pgs=3929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.934 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.932+0000 7f2dd7a4aec0 1 -- 172.21.15.57:0/1267398698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a09540 msgr2=0x1b306e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.934 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.932+0000 7f2dd7a4aec0 1 --2- 172.21.15.57:0/1267398698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a09540 0x1b306e0 crc :-1 s=READY pgs=12861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.934 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.932+0000 7f2dd7a4aec0 1 -- 172.21.15.57:0/1267398698 shutdown_connections 2024-04-24T02:05:17.934 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.932+0000 7f2dd7a4aec0 1 --2- 172.21.15.57:0/1267398698 >> v2:172.21.15.57:6801/2208289758 conn(0x1a9bab0 0x1a873e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.934 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.932+0000 7f2dd7a4aec0 1 --2- 172.21.15.57:0/1267398698 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f2db8037210 0x7f2db8039720 unknown :-1 s=CLOSED pgs=3929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.934 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.932+0000 7f2dd7a4aec0 1 --2- 172.21.15.57:0/1267398698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a09540 0x1b306e0 unknown :-1 s=CLOSED pgs=12861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.934 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.932+0000 7f2dd7a4aec0 1 -- 172.21.15.57:0/1267398698 >> 172.21.15.57:0/1267398698 conn(0x1925960 msgr2=0x1a02da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:17.934 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.932+0000 7f2dd7a4aec0 1 -- 172.21.15.57:0/1267398698 shutdown_connections 2024-04-24T02:05:17.934 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.932+0000 7f2dd7a4aec0 1 -- 172.21.15.57:0/1267398698 wait complete. 2024-04-24T02:05:17.935 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in `seq 1 10` 2024-04-24T02:05:17.935 INFO:tasks.workunit.client.0.smithi057.stderr:+ rados -p 319496fe-d53f-40fe-a120-83451e8717ac put obj9 /etc/passwd 2024-04-24T02:05:17.972 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.971+0000 7f59d36c9ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:17.978 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.977+0000 7f59d36c9ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:17.978 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.977+0000 7f59d36c9ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:17.979 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.978+0000 7f59d36c9ec0 1 Processor -- start 2024-04-24T02:05:17.979 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.978+0000 7f59d36c9ec0 1 -- start start 2024-04-24T02:05:17.981 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.979+0000 7f59d36c9ec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xd9a660 0xd9e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.981 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.979+0000 7f59d36c9ec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0xc6d950 con 0xd9a660 2024-04-24T02:05:17.981 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.979+0000 7f59c6ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xd9a660 0xd9e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:17.981 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.979+0000 7f59c6ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xd9a660 0xd9e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34296/0 (socket says 172.21.15.57:34296) 2024-04-24T02:05:17.981 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.979+0000 7f59c6ffd640 1 -- 172.21.15.57:0/2796062765 learned_addr learned my addr 172.21.15.57:0/2796062765 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:05:17.981 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.980+0000 7f59c6ffd640 1 -- 172.21.15.57:0/2796062765 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xc0c1e0 con 0xd9a660 2024-04-24T02:05:17.981 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.980+0000 7f59c6ffd640 1 --2- 172.21.15.57:0/2796062765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xd9a660 0xd9e8a0 crc :-1 s=READY pgs=12864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd987fc5d77b177f server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.981 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.980+0000 7f59c57fa640 1 -- 172.21.15.57:0/2796062765 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f59b800c490 con 0xd9a660 2024-04-24T02:05:17.982 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.980+0000 7f59c57fa640 1 -- 172.21.15.57:0/2796062765 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f59b800c5f0 con 0xd9a660 2024-04-24T02:05:17.982 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.980+0000 7f59c57fa640 1 -- 172.21.15.57:0/2796062765 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f59b800c890 con 0xd9a660 2024-04-24T02:05:17.983 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.981+0000 7f59d36c9ec0 1 -- 172.21.15.57:0/2796062765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xd9a660 msgr2=0xd9e8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:17.983 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.981+0000 7f59d36c9ec0 1 --2- 172.21.15.57:0/2796062765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xd9a660 0xd9e8a0 crc :-1 s=READY pgs=12864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.983 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.981+0000 7f59d36c9ec0 1 -- 172.21.15.57:0/2796062765 shutdown_connections 2024-04-24T02:05:17.983 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.981+0000 7f59d36c9ec0 1 --2- 172.21.15.57:0/2796062765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xd9a660 0xd9e8a0 unknown :-1 s=CLOSED pgs=12864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:17.983 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.981+0000 7f59d36c9ec0 1 -- 172.21.15.57:0/2796062765 >> 172.21.15.57:0/2796062765 conn(0xc24960 msgr2=0xd0a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:17.983 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.981+0000 7f59d36c9ec0 1 -- 172.21.15.57:0/2796062765 shutdown_connections 2024-04-24T02:05:17.983 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.981+0000 7f59d36c9ec0 1 -- 172.21.15.57:0/2796062765 wait complete. 2024-04-24T02:05:17.983 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.982+0000 7f59d36c9ec0 1 Processor -- start 2024-04-24T02:05:17.983 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.982+0000 7f59d36c9ec0 1 -- start start 2024-04-24T02:05:17.985 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.983+0000 7f59d36c9ec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xd9a660 0xd033e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.985 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.983+0000 7f59d36c9ec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0xc6b3d0 con 0xd9a660 2024-04-24T02:05:17.985 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.983+0000 7f59c6ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xd9a660 0xd033e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:17.985 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.983+0000 7f59c6ffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xd9a660 0xd033e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34298/0 (socket says 172.21.15.57:34298) 2024-04-24T02:05:17.985 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.983+0000 7f59c6ffd640 1 -- 172.21.15.57:0/292322392 learned_addr learned my addr 172.21.15.57:0/292322392 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:05:17.985 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.983+0000 7f59c6ffd640 1 -- 172.21.15.57:0/292322392 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xbfee30 con 0xd9a660 2024-04-24T02:05:17.985 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.984+0000 7f59c6ffd640 1 --2- 172.21.15.57:0/292322392 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xd9a660 0xd033e0 crc :-1 s=READY pgs=12865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.985 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.984+0000 7f59affff640 1 -- 172.21.15.57:0/292322392 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f59b8016040 con 0xd9a660 2024-04-24T02:05:17.986 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.984+0000 7f59affff640 1 -- 172.21.15.57:0/292322392 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f59b8011980 con 0xd9a660 2024-04-24T02:05:17.986 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.984+0000 7f59d36c9ec0 1 -- 172.21.15.57:0/292322392 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xbfe890 con 0xd9a660 2024-04-24T02:05:17.986 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.984+0000 7f59d36c9ec0 1 -- 172.21.15.57:0/292322392 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0xd89b00 con 0xd9a660 2024-04-24T02:05:17.986 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.984+0000 7f59affff640 1 -- 172.21.15.57:0/292322392 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f59b8011c20 con 0xd9a660 2024-04-24T02:05:17.987 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.985+0000 7f59affff640 1 -- 172.21.15.57:0/292322392 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f59b800e440 con 0xd9a660 2024-04-24T02:05:17.987 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.985+0000 7f59affff640 1 --2- 172.21.15.57:0/292322392 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f59b4037210 0x7f59b4039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.987 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.985+0000 7f59affff640 1 -- 172.21.15.57:0/292322392 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(688..688 src has 395..688) ==== 3791+0+0 (crc 0 0 0) 0x7f59b8048ed0 con 0xd9a660 2024-04-24T02:05:17.987 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.985+0000 7f59d36c9ec0 1 --2- 172.21.15.57:0/292322392 >> v2:172.21.15.84:6808/91137974 conn(0xd9b180 0xd03e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:17.987 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.985+0000 7f59d36c9ec0 1 -- 172.21.15.57:0/292322392 --> v2:172.21.15.84:6808/91137974 -- osd_op(unknown.0.0:1 200.7 200:fe351e27:::obj9:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e688) -- 0xd980b0 con 0xd9b180 2024-04-24T02:05:17.987 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.985+0000 7f59c67fc640 1 --2- 172.21.15.57:0/292322392 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f59b4037210 0x7f59b4039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:17.987 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.986+0000 7f59c67fc640 1 --2- 172.21.15.57:0/292322392 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f59b4037210 0x7f59b4039720 crc :-1 s=READY pgs=3930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:17.988 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.986+0000 7f59c77fe640 1 --2- 172.21.15.57:0/292322392 >> v2:172.21.15.84:6808/91137974 conn(0xd9b180 0xd03e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T02:05:17.992 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:17.991+0000 7f59c77fe640 1 --2- 172.21.15.57:0/292322392 >> v2:172.21.15.84:6808/91137974 conn(0xd9b180 0xd03e30 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:18.003 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.001+0000 7f59c77fe640 1 -- 172.21.15.57:0/292322392 <== osd.3 v2:172.21.15.84:6808/91137974 1 ==== osd_op_reply(1 obj9 [writefull 0~11876] v688'2 uv2 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f59c000a430 con 0xd9b180 2024-04-24T02:05:18.003 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.001+0000 7f59d36c9ec0 1 -- 172.21.15.57:0/292322392 >> v2:172.21.15.84:6808/91137974 conn(0xd9b180 msgr2=0xd03e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:18.004 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.001+0000 7f59d36c9ec0 1 --2- 172.21.15.57:0/292322392 >> v2:172.21.15.84:6808/91137974 conn(0xd9b180 0xd03e30 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:18.004 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.001+0000 7f59d36c9ec0 1 -- 172.21.15.57:0/292322392 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f59b4037210 msgr2=0x7f59b4039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:18.004 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.001+0000 7f59d36c9ec0 1 --2- 172.21.15.57:0/292322392 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f59b4037210 0x7f59b4039720 crc :-1 s=READY pgs=3930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:18.004 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.001+0000 7f59d36c9ec0 1 -- 172.21.15.57:0/292322392 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xd9a660 msgr2=0xd033e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:18.004 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.001+0000 7f59d36c9ec0 1 --2- 172.21.15.57:0/292322392 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xd9a660 0xd033e0 crc :-1 s=READY pgs=12865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:18.004 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.002+0000 7f59d36c9ec0 1 -- 172.21.15.57:0/292322392 shutdown_connections 2024-04-24T02:05:18.004 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.002+0000 7f59d36c9ec0 1 --2- 172.21.15.57:0/292322392 >> v2:172.21.15.84:6808/91137974 conn(0xd9b180 0xd03e30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:18.004 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.002+0000 7f59d36c9ec0 1 --2- 172.21.15.57:0/292322392 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f59b4037210 0x7f59b4039720 unknown :-1 s=CLOSED pgs=3930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:18.004 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.002+0000 7f59d36c9ec0 1 --2- 172.21.15.57:0/292322392 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xd9a660 0xd033e0 unknown :-1 s=CLOSED pgs=12865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:18.004 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.002+0000 7f59d36c9ec0 1 -- 172.21.15.57:0/292322392 >> 172.21.15.57:0/292322392 conn(0xc24960 msgr2=0xd0a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:18.004 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.002+0000 7f59d36c9ec0 1 -- 172.21.15.57:0/292322392 shutdown_connections 2024-04-24T02:05:18.004 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.002+0000 7f59d36c9ec0 1 -- 172.21.15.57:0/292322392 wait complete. 2024-04-24T02:05:18.005 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in `seq 1 10` 2024-04-24T02:05:18.005 INFO:tasks.workunit.client.0.smithi057.stderr:+ rados -p 319496fe-d53f-40fe-a120-83451e8717ac put obj10 /etc/passwd 2024-04-24T02:05:18.041 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.040+0000 7f412b8e4ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:18.047 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.046+0000 7f412b8e4ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:18.047 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.046+0000 7f412b8e4ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:18.048 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.047+0000 7f412b8e4ec0 1 Processor -- start 2024-04-24T02:05:18.048 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.047+0000 7f412b8e4ec0 1 -- start start 2024-04-24T02:05:18.050 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.048+0000 7f412b8e4ec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x2135540 0x21b0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:18.050 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.048+0000 7f412b8e4ec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x209a950 con 0x2135540 2024-04-24T02:05:18.050 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.048+0000 7f411effd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x2135540 0x21b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:18.050 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.048+0000 7f411effd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x2135540 0x21b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34326/0 (socket says 172.21.15.57:34326) 2024-04-24T02:05:18.050 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.048+0000 7f411effd640 1 -- 172.21.15.57:0/1577885000 learned_addr learned my addr 172.21.15.57:0/1577885000 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:05:18.050 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.049+0000 7f411effd640 1 -- 172.21.15.57:0/1577885000 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x20391e0 con 0x2135540 2024-04-24T02:05:18.050 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.049+0000 7f411effd640 1 --2- 172.21.15.57:0/1577885000 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x2135540 0x21b0180 crc :-1 s=READY pgs=12868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d693b5d59cc6159 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:18.051 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.049+0000 7f411d7fa640 1 -- 172.21.15.57:0/1577885000 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4118032040 con 0x2135540 2024-04-24T02:05:18.051 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.049+0000 7f411d7fa640 1 -- 172.21.15.57:0/1577885000 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f411800a040 con 0x2135540 2024-04-24T02:05:18.051 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.049+0000 7f411d7fa640 1 -- 172.21.15.57:0/1577885000 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f411800a2e0 con 0x2135540 2024-04-24T02:05:18.052 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.049+0000 7f412b8e4ec0 1 -- 172.21.15.57:0/1577885000 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x2135540 msgr2=0x21b0180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:18.052 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.049+0000 7f412b8e4ec0 1 --2- 172.21.15.57:0/1577885000 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x2135540 0x21b0180 crc :-1 s=READY pgs=12868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:18.052 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.050+0000 7f412b8e4ec0 1 -- 172.21.15.57:0/1577885000 shutdown_connections 2024-04-24T02:05:18.052 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.050+0000 7f412b8e4ec0 1 --2- 172.21.15.57:0/1577885000 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x2135540 0x21b0180 unknown :-1 s=CLOSED pgs=12868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:18.052 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.050+0000 7f412b8e4ec0 1 -- 172.21.15.57:0/1577885000 >> 172.21.15.57:0/1577885000 conn(0x2051960 msgr2=0x212eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:18.052 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.050+0000 7f412b8e4ec0 1 -- 172.21.15.57:0/1577885000 shutdown_connections 2024-04-24T02:05:18.052 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.050+0000 7f412b8e4ec0 1 -- 172.21.15.57:0/1577885000 wait complete. 2024-04-24T02:05:18.052 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.051+0000 7f412b8e4ec0 1 Processor -- start 2024-04-24T02:05:18.052 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.051+0000 7f412b8e4ec0 1 -- start start 2024-04-24T02:05:18.054 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.052+0000 7f412b8e4ec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x2135540 0x225c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:18.054 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.052+0000 7f412b8e4ec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x20983d0 con 0x2135540 2024-04-24T02:05:18.054 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.052+0000 7f411effd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x2135540 0x225c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:18.054 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.052+0000 7f411effd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x2135540 0x225c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34342/0 (socket says 172.21.15.57:34342) 2024-04-24T02:05:18.055 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.052+0000 7f411effd640 1 -- 172.21.15.57:0/2792801111 learned_addr learned my addr 172.21.15.57:0/2792801111 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:05:18.055 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.053+0000 7f411effd640 1 -- 172.21.15.57:0/2792801111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x202be30 con 0x2135540 2024-04-24T02:05:18.055 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.053+0000 7f411effd640 1 --2- 172.21.15.57:0/2792801111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x2135540 0x225c6e0 crc :-1 s=READY pgs=12869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:18.055 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.053+0000 7f4117fff640 1 -- 172.21.15.57:0/2792801111 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f411802d650 con 0x2135540 2024-04-24T02:05:18.055 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.053+0000 7f4117fff640 1 -- 172.21.15.57:0/2792801111 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f411802d7b0 con 0x2135540 2024-04-24T02:05:18.055 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.053+0000 7f4117fff640 1 -- 172.21.15.57:0/2792801111 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f411802da50 con 0x2135540 2024-04-24T02:05:18.055 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.053+0000 7f412b8e4ec0 1 -- 172.21.15.57:0/2792801111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x202b890 con 0x2135540 2024-04-24T02:05:18.055 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.053+0000 7f412b8e4ec0 1 -- 172.21.15.57:0/2792801111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x21b4790 con 0x2135540 2024-04-24T02:05:18.056 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.054+0000 7f4117fff640 1 -- 172.21.15.57:0/2792801111 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f411802dc00 con 0x2135540 2024-04-24T02:05:18.056 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.054+0000 7f4117fff640 1 --2- 172.21.15.57:0/2792801111 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f4100037210 0x7f4100039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:18.056 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.054+0000 7f4117fff640 1 -- 172.21.15.57:0/2792801111 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(688..688 src has 395..688) ==== 3791+0+0 (crc 0 0 0) 0x7f4118032040 con 0x2135540 2024-04-24T02:05:18.056 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.054+0000 7f412b8e4ec0 1 --2- 172.21.15.57:0/2792801111 >> v2:172.21.15.57:6801/2208289758 conn(0x21c7ab0 0x21b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:18.056 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.054+0000 7f412b8e4ec0 1 -- 172.21.15.57:0/2792801111 --> v2:172.21.15.57:6801/2208289758 -- osd_op(unknown.0.0:1 200.b 200:d1337354:::obj10:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e688) -- 0x21b6780 con 0x21c7ab0 2024-04-24T02:05:18.056 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.055+0000 7f411e7fc640 1 --2- 172.21.15.57:0/2792801111 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f4100037210 0x7f4100039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:18.057 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.055+0000 7f411e7fc640 1 --2- 172.21.15.57:0/2792801111 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f4100037210 0x7f4100039720 crc :-1 s=READY pgs=3931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:18.057 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.055+0000 7f411f7fe640 1 --2- 172.21.15.57:0/2792801111 >> v2:172.21.15.57:6801/2208289758 conn(0x21c7ab0 0x21b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T02:05:18.060 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.059+0000 7f411f7fe640 1 --2- 172.21.15.57:0/2792801111 >> v2:172.21.15.57:6801/2208289758 conn(0x21c7ab0 0x21b33e0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:18.072 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.070+0000 7f411f7fe640 1 -- 172.21.15.57:0/2792801111 <== osd.0 v2:172.21.15.57:6801/2208289758 1 ==== osd_op_reply(1 obj10 [writefull 0~11876] v688'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f411000a430 con 0x21c7ab0 2024-04-24T02:05:18.072 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.070+0000 7f412b8e4ec0 1 -- 172.21.15.57:0/2792801111 >> v2:172.21.15.57:6801/2208289758 conn(0x21c7ab0 msgr2=0x21b33e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:18.072 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.070+0000 7f412b8e4ec0 1 --2- 172.21.15.57:0/2792801111 >> v2:172.21.15.57:6801/2208289758 conn(0x21c7ab0 0x21b33e0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:18.072 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.070+0000 7f412b8e4ec0 1 -- 172.21.15.57:0/2792801111 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f4100037210 msgr2=0x7f4100039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:18.072 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.070+0000 7f412b8e4ec0 1 --2- 172.21.15.57:0/2792801111 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f4100037210 0x7f4100039720 crc :-1 s=READY pgs=3931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:18.072 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.070+0000 7f412b8e4ec0 1 -- 172.21.15.57:0/2792801111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x2135540 msgr2=0x225c6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:18.072 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.070+0000 7f412b8e4ec0 1 --2- 172.21.15.57:0/2792801111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x2135540 0x225c6e0 crc :-1 s=READY pgs=12869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:18.072 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.070+0000 7f412b8e4ec0 1 -- 172.21.15.57:0/2792801111 shutdown_connections 2024-04-24T02:05:18.072 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.070+0000 7f412b8e4ec0 1 --2- 172.21.15.57:0/2792801111 >> v2:172.21.15.57:6801/2208289758 conn(0x21c7ab0 0x21b33e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:18.072 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.070+0000 7f412b8e4ec0 1 --2- 172.21.15.57:0/2792801111 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f4100037210 0x7f4100039720 unknown :-1 s=CLOSED pgs=3931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:18.072 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.070+0000 7f412b8e4ec0 1 --2- 172.21.15.57:0/2792801111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x2135540 0x225c6e0 unknown :-1 s=CLOSED pgs=12869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:18.072 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.070+0000 7f412b8e4ec0 1 -- 172.21.15.57:0/2792801111 >> 172.21.15.57:0/2792801111 conn(0x2051960 msgr2=0x212eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:18.073 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.070+0000 7f412b8e4ec0 1 -- 172.21.15.57:0/2792801111 shutdown_connections 2024-04-24T02:05:18.073 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:18.070+0000 7f412b8e4ec0 1 -- 172.21.15.57:0/2792801111 wait complete. 2024-04-24T02:05:18.074 INFO:tasks.workunit.client.0.smithi057.stderr:+ sleep 30 2024-04-24T02:05:48.076 INFO:tasks.workunit.client.0.smithi057.stderr:+ pid=96551 2024-04-24T02:05:48.077 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph osd pool set-quota 319496fe-d53f-40fe-a120-83451e8717ac max_objects 100 2024-04-24T02:05:48.077 INFO:tasks.workunit.client.0.smithi057.stderr:+ rados -p 319496fe-d53f-40fe-a120-83451e8717ac put onemore /etc/passwd 2024-04-24T02:05:48.120 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.119+0000 7fcaa18fcec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:48.128 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.126+0000 7fcaa18fcec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:48.128 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.126+0000 7fcaa18fcec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:48.129 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.128+0000 7fcaa18fcec0 1 Processor -- start 2024-04-24T02:05:48.129 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.128+0000 7fcaa18fcec0 1 -- start start 2024-04-24T02:05:48.132 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.130+0000 7fcaa18fcec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1954f40 0x19eb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:48.132 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.130+0000 7fcaa18fcec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x18bc950 con 0x1954f40 2024-04-24T02:05:48.133 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.131+0000 7fca99d9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1954f40 0x19eb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:48.133 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.131+0000 7fca99d9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1954f40 0x19eb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:32988/0 (socket says 172.21.15.57:32988) 2024-04-24T02:05:48.133 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.131+0000 7fca99d9b640 1 -- 172.21.15.57:0/2014001584 learned_addr learned my addr 172.21.15.57:0/2014001584 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:05:48.133 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.131+0000 7fca99d9b640 1 -- 172.21.15.57:0/2014001584 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x185b1e0 con 0x1954f40 2024-04-24T02:05:48.133 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.131+0000 7fca99d9b640 1 --2- 172.21.15.57:0/2014001584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1954f40 0x19eb7e0 crc :-1 s=READY pgs=12872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eb11a6d9fb85f58 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:48.133 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.131+0000 7fca937fe640 1 -- 172.21.15.57:0/2014001584 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fca8400b4a0 con 0x1954f40 2024-04-24T02:05:48.133 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.131+0000 7fca937fe640 1 -- 172.21.15.57:0/2014001584 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fca8400b600 con 0x1954f40 2024-04-24T02:05:48.133 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.131+0000 7fca937fe640 1 -- 172.21.15.57:0/2014001584 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fca8400b8a0 con 0x1954f40 2024-04-24T02:05:48.134 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.132+0000 7fcaa18fcec0 1 -- 172.21.15.57:0/2014001584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1954f40 msgr2=0x19eb7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:48.134 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.132+0000 7fcaa18fcec0 1 --2- 172.21.15.57:0/2014001584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1954f40 0x19eb7e0 crc :-1 s=READY pgs=12872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:48.134 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.132+0000 7fcaa18fcec0 1 -- 172.21.15.57:0/2014001584 shutdown_connections 2024-04-24T02:05:48.134 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.132+0000 7fcaa18fcec0 1 --2- 172.21.15.57:0/2014001584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1954f40 0x19eb7e0 unknown :-1 s=CLOSED pgs=12872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:48.135 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.133+0000 7fcaa18fcec0 1 -- 172.21.15.57:0/2014001584 >> 172.21.15.57:0/2014001584 conn(0x1873960 msgr2=0x195a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:48.135 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.133+0000 7fcaa18fcec0 1 -- 172.21.15.57:0/2014001584 shutdown_connections 2024-04-24T02:05:48.135 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.133+0000 7fcaa18fcec0 1 -- 172.21.15.57:0/2014001584 wait complete. 2024-04-24T02:05:48.135 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.134+0000 7fcaa18fcec0 1 Processor -- start 2024-04-24T02:05:48.135 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.134+0000 7fcaa18fcec0 1 -- start start 2024-04-24T02:05:48.137 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.135+0000 7fcaa18fcec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1954f40 0x193dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:48.137 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.135+0000 7fcaa18fcec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x18ba3d0 con 0x1954f40 2024-04-24T02:05:48.137 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.136+0000 7fca99d9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1954f40 0x193dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:48.137 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.136+0000 7fca99d9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1954f40 0x193dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:32998/0 (socket says 172.21.15.57:32998) 2024-04-24T02:05:48.137 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.136+0000 7fca99d9b640 1 -- 172.21.15.57:0/956805854 learned_addr learned my addr 172.21.15.57:0/956805854 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:05:48.137 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.136+0000 7fca99d9b640 1 -- 172.21.15.57:0/956805854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x184de30 con 0x1954f40 2024-04-24T02:05:48.138 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.136+0000 7fca99d9b640 1 --2- 172.21.15.57:0/956805854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1954f40 0x193dc00 crc :-1 s=READY pgs=12873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:48.138 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.137+0000 7fca927fc640 1 -- 172.21.15.57:0/956805854 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fca840110b0 con 0x1954f40 2024-04-24T02:05:48.138 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.137+0000 7fca927fc640 1 -- 172.21.15.57:0/956805854 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fca84011210 con 0x1954f40 2024-04-24T02:05:48.139 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.137+0000 7fcaa18fcec0 1 -- 172.21.15.57:0/956805854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x184d890 con 0x1954f40 2024-04-24T02:05:48.139 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.137+0000 7fca927fc640 1 -- 172.21.15.57:0/956805854 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fca84011b00 con 0x1954f40 2024-04-24T02:05:48.139 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.137+0000 7fcaa18fcec0 1 -- 172.21.15.57:0/956805854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x193d610 con 0x1954f40 2024-04-24T02:05:48.139 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.138+0000 7fca927fc640 1 -- 172.21.15.57:0/956805854 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fca84011d40 con 0x1954f40 2024-04-24T02:05:48.140 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.138+0000 7fca927fc640 1 --2- 172.21.15.57:0/956805854 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fca740371c0 0x7fca740396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:48.140 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.138+0000 7fca927fc640 1 -- 172.21.15.57:0/956805854 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(690..690 src has 395..690) ==== 3791+0+0 (crc 0 0 0) 0x7fca84048ba0 con 0x1954f40 2024-04-24T02:05:48.140 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.138+0000 7fca927fc640 1 -- 172.21.15.57:0/956805854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=691}) -- 0x7fca7403d430 con 0x1954f40 2024-04-24T02:05:48.140 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.138+0000 7fcaa18fcec0 1 --2- 172.21.15.57:0/956805854 >> v2:172.21.15.57:6801/2208289758 conn(0x1956050 0x1a82fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:48.140 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.138+0000 7fca9959a640 1 --2- 172.21.15.57:0/956805854 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fca740371c0 0x7fca740396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:48.140 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.139+0000 7fca9959a640 1 --2- 172.21.15.57:0/956805854 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fca740371c0 0x7fca740396d0 crc :-1 s=READY pgs=3932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:48.141 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.140+0000 7fca9a59c640 1 --2- 172.21.15.57:0/956805854 >> v2:172.21.15.57:6801/2208289758 conn(0x1956050 0x1a82fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T02:05:48.145 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.144+0000 7fca9a59c640 1 --2- 172.21.15.57:0/956805854 >> v2:172.21.15.57:6801/2208289758 conn(0x1956050 0x1a82fb0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:48.188 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.178+0000 7fe88162d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:48.189 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.188+0000 7fe88162d640 1 Processor -- start 2024-04-24T02:05:48.189 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.188+0000 7fe88162d640 1 -- start start 2024-04-24T02:05:48.190 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.189+0000 7fe88162d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe87c135060 0x7fe87c135470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:48.191 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.189+0000 7fe88162d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe87c1359b0 con 0x7fe87c0a25b0 2024-04-24T02:05:48.191 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.189+0000 7fe88162d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fe87c09be70 con 0x7fe87c135060 2024-04-24T02:05:48.191 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.189+0000 7fe87affd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe87c135060 0x7fe87c135470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:48.191 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.189+0000 7fe87a7fc640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe87c0a25b0 0x7fe87c0a29c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46046/0 (socket says 172.21.15.57:46046) 2024-04-24T02:05:48.191 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.189+0000 7fe87affd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe87c135060 0x7fe87c135470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33000/0 (socket says 172.21.15.57:33000) 2024-04-24T02:05:48.191 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.189+0000 7fe87a7fc640 1 -- 172.21.15.57:0/3681880241 learned_addr learned my addr 172.21.15.57:0/3681880241 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T02:05:48.192 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.190+0000 7fe87affd640 1 -- 172.21.15.57:0/3681880241 >> v1:172.21.15.57:6789/0 conn(0x7fe87c0a25b0 legacy=0x7fe87c0a29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:48.192 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.190+0000 7fe87affd640 1 -- 172.21.15.57:0/3681880241 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe87c134c30 con 0x7fe87c135060 2024-04-24T02:05:48.193 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.190+0000 7fe87affd640 1 --2- 172.21.15.57:0/3681880241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe87c135060 0x7fe87c135470 crc :-1 s=READY pgs=12875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d73c29d204510e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:48.193 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.190+0000 7fe879ffb640 1 -- 172.21.15.57:0/3681880241 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe86c009d90 con 0x7fe87c135060 2024-04-24T02:05:48.193 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.190+0000 7fe879ffb640 1 -- 172.21.15.57:0/3681880241 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe86c00e230 con 0x7fe87c135060 2024-04-24T02:05:48.193 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.190+0000 7fe879ffb640 1 -- 172.21.15.57:0/3681880241 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe86c00e4d0 con 0x7fe87c135060 2024-04-24T02:05:48.193 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.191+0000 7fe88162d640 1 -- 172.21.15.57:0/3681880241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe87c135060 msgr2=0x7fe87c135470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:48.193 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.191+0000 7fe88162d640 1 --2- 172.21.15.57:0/3681880241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe87c135060 0x7fe87c135470 crc :-1 s=READY pgs=12875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:48.193 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.191+0000 7fe88162d640 1 -- 172.21.15.57:0/3681880241 shutdown_connections 2024-04-24T02:05:48.193 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.191+0000 7fe88162d640 1 --2- 172.21.15.57:0/3681880241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe87c135060 0x7fe87c135470 unknown :-1 s=CLOSED pgs=12875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:48.193 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.191+0000 7fe88162d640 1 -- 172.21.15.57:0/3681880241 >> 172.21.15.57:0/3681880241 conn(0x7fe87c06d420 msgr2=0x7fe87c06d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:48.193 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.191+0000 7fe88162d640 1 -- 172.21.15.57:0/3681880241 shutdown_connections 2024-04-24T02:05:48.193 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.191+0000 7fe88162d640 1 -- 172.21.15.57:0/3681880241 wait complete. 2024-04-24T02:05:48.193 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.191+0000 7fe88162d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:48.194 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.193+0000 7fe88162d640 1 Processor -- start 2024-04-24T02:05:48.194 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.193+0000 7fe88162d640 1 -- start start 2024-04-24T02:05:48.197 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.195+0000 7fe88162d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe87c0a25b0 0x7fe87c09e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:48.197 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.195+0000 7fe88162d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe87c11d3f0 con 0x7fe87c0a25b0 2024-04-24T02:05:48.197 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.195+0000 7fe87affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe87c0a25b0 0x7fe87c09e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:48.197 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.195+0000 7fe87affd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe87c0a25b0 0x7fe87c09e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33014/0 (socket says 172.21.15.57:33014) 2024-04-24T02:05:48.197 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.195+0000 7fe87affd640 1 -- 172.21.15.57:0/3341983577 learned_addr learned my addr 172.21.15.57:0/3341983577 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:05:48.197 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.195+0000 7fe87affd640 1 -- 172.21.15.57:0/3341983577 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe87c0a0350 con 0x7fe87c0a25b0 2024-04-24T02:05:48.197 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.195+0000 7fe87affd640 1 --2- 172.21.15.57:0/3341983577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe87c0a25b0 0x7fe87c09e6f0 crc :-1 s=READY pgs=12876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:48.197 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.195+0000 7fe8637fe640 1 -- 172.21.15.57:0/3341983577 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe86c014540 con 0x7fe87c0a25b0 2024-04-24T02:05:48.197 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.195+0000 7fe8637fe640 1 -- 172.21.15.57:0/3341983577 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fe86c0146a0 con 0x7fe87c0a25b0 2024-04-24T02:05:48.197 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.195+0000 7fe88162d640 1 -- 172.21.15.57:0/3341983577 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe87c12ee40 con 0x7fe87c0a25b0 2024-04-24T02:05:48.197 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.195+0000 7fe8637fe640 1 -- 172.21.15.57:0/3341983577 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fe86c014940 con 0x7fe87c0a25b0 2024-04-24T02:05:48.197 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.195+0000 7fe88162d640 1 -- 172.21.15.57:0/3341983577 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe87c11dab0 con 0x7fe87c0a25b0 2024-04-24T02:05:48.198 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.196+0000 7fe8637fe640 1 -- 172.21.15.57:0/3341983577 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fe86c014af0 con 0x7fe87c0a25b0 2024-04-24T02:05:48.198 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.197+0000 7fe88162d640 1 -- 172.21.15.57:0/3341983577 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe87c09fc20 con 0x7fe87c0a25b0 2024-04-24T02:05:48.199 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.197+0000 7fe8637fe640 1 --2- 172.21.15.57:0/3341983577 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fe868038980 0x7fe86803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:48.199 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.197+0000 7fe8637fe640 1 -- 172.21.15.57:0/3341983577 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(690..690 src has 395..690) ==== 3791+0+0 (crc 0 0 0) 0x7fe86c019040 con 0x7fe87c0a25b0 2024-04-24T02:05:48.199 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.197+0000 7fe8637fe640 1 -- 172.21.15.57:0/3341983577 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=691}) -- 0x7fe86803eb90 con 0x7fe87c0a25b0 2024-04-24T02:05:48.199 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.197+0000 7fe87a7fc640 1 --2- 172.21.15.57:0/3341983577 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fe868038980 0x7fe86803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:48.199 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.198+0000 7fe87a7fc640 1 --2- 172.21.15.57:0/3341983577 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fe868038980 0x7fe86803ae90 crc :-1 s=READY pgs=3933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:48.203 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.202+0000 7fe8637fe640 1 -- 172.21.15.57:0/3341983577 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fe86c018190 con 0x7fe87c0a25b0 2024-04-24T02:05:48.391 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.390+0000 7fe88162d640 1 -- 172.21.15.57:0/3341983577 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "field": "max_objects", "val": "100"} v 0) -- 0x7fe87c11ef80 con 0x7fe87c0a25b0 2024-04-24T02:05:48.817 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.815+0000 7fe8637fe640 1 -- 172.21.15.57:0/3341983577 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 319496fe-d53f-40fe-a120-83451e8717ac v691) ==== 225+0+0 (crc 0 0 0) 0x7fe86c00fb30 con 0x7fe87c0a25b0 2024-04-24T02:05:48.819 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.818+0000 7fe8637fe640 1 -- 172.21.15.57:0/3341983577 <== mon.0 v2:172.21.15.57:3300/0 8 ==== osd_map(691..691 src has 395..691) ==== 628+0+0 (crc 0 0 0) 0x7fe86c010310 con 0x7fe87c0a25b0 2024-04-24T02:05:48.819 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.818+0000 7fca927fc640 1 -- 172.21.15.57:0/956805854 <== mon.0 v2:172.21.15.57:3300/0 6 ==== osd_map(691..691 src has 395..691) ==== 628+0+0 (crc 0 0 0) 0x7fca8400c360 con 0x1954f40 2024-04-24T02:05:48.819 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.818+0000 7fe8637fe640 1 -- 172.21.15.57:0/3341983577 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=692}) -- 0x7fe86803fad0 con 0x7fe87c0a25b0 2024-04-24T02:05:48.819 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.818+0000 7fca927fc640 1 -- 172.21.15.57:0/956805854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=692}) -- 0x7fca7403dac0 con 0x1954f40 2024-04-24T02:05:48.930 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:48.929+0000 7fe88162d640 1 -- 172.21.15.57:0/3341983577 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "field": "max_objects", "val": "100"} v 0) -- 0x7fe87c11d1f0 con 0x7fe87c0a25b0 2024-04-24T02:05:49.828 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:49.827+0000 7fe8637fe640 1 -- 172.21.15.57:0/3341983577 <== mon.0 v2:172.21.15.57:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 319496fe-d53f-40fe-a120-83451e8717ac v692) ==== 225+0+0 (crc 0 0 0) 0x7fe86c00fd10 con 0x7fe87c0a25b0 2024-04-24T02:05:49.828 INFO:tasks.workunit.client.0.smithi057.stderr:set-quota max_objects = 100 for pool 319496fe-d53f-40fe-a120-83451e8717ac 2024-04-24T02:05:49.830 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:49.829+0000 7fe8637fe640 1 -- 172.21.15.57:0/3341983577 <== mon.0 v2:172.21.15.57:3300/0 10 ==== osd_map(692..692 src has 395..692) ==== 628+0+0 (crc 0 0 0) 0x7fe86c014da0 con 0x7fe87c0a25b0 2024-04-24T02:05:49.830 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:49.829+0000 7fca927fc640 1 -- 172.21.15.57:0/956805854 <== mon.0 v2:172.21.15.57:3300/0 7 ==== osd_map(692..692 src has 395..692) ==== 628+0+0 (crc 0 0 0) 0x7fca8400c540 con 0x1954f40 2024-04-24T02:05:49.830 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:49.829+0000 7fe8637fe640 1 -- 172.21.15.57:0/3341983577 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=693}) -- 0x7fe86803fbf0 con 0x7fe87c0a25b0 2024-04-24T02:05:49.830 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:49.829+0000 7fca927fc640 1 -- 172.21.15.57:0/956805854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=693}) -- 0x7fca7403dce0 con 0x1954f40 2024-04-24T02:05:49.831 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:49.830+0000 7fe88162d640 1 -- 172.21.15.57:0/3341983577 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fe868038980 msgr2=0x7fe86803ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:49.831 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:49.830+0000 7fe88162d640 1 --2- 172.21.15.57:0/3341983577 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fe868038980 0x7fe86803ae90 crc :-1 s=READY pgs=3933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:49.831 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:49.830+0000 7fe88162d640 1 -- 172.21.15.57:0/3341983577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe87c0a25b0 msgr2=0x7fe87c09e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:49.831 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:49.830+0000 7fe88162d640 1 --2- 172.21.15.57:0/3341983577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe87c0a25b0 0x7fe87c09e6f0 crc :-1 s=READY pgs=12876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:49.831 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:49.830+0000 7fe88162d640 1 -- 172.21.15.57:0/3341983577 shutdown_connections 2024-04-24T02:05:49.831 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:49.830+0000 7fe88162d640 1 --2- 172.21.15.57:0/3341983577 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fe868038980 0x7fe86803ae90 unknown :-1 s=CLOSED pgs=3933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:49.832 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:49.830+0000 7fe88162d640 1 --2- 172.21.15.57:0/3341983577 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe87c0a25b0 0x7fe87c09e6f0 unknown :-1 s=CLOSED pgs=12876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:49.832 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:49.830+0000 7fe88162d640 1 -- 172.21.15.57:0/3341983577 >> 172.21.15.57:0/3341983577 conn(0x7fe87c06d420 msgr2=0x7fe87c1328b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:49.832 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:49.830+0000 7fe88162d640 1 -- 172.21.15.57:0/3341983577 shutdown_connections 2024-04-24T02:05:49.832 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:49.830+0000 7fe88162d640 1 -- 172.21.15.57:0/3341983577 wait complete. 2024-04-24T02:05:49.843 INFO:tasks.workunit.client.0.smithi057.stderr:+ wait 96551 2024-04-24T02:05:53.138 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:53.138+0000 7fca9b7fe640 1 -- 172.21.15.57:0/956805854 --> v2:172.21.15.57:6801/2208289758 -- ping magic: 0 -- 0x7fca70000b90 con 0x1956050 2024-04-24T02:05:53.721 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:53.719+0000 7fca927fc640 1 -- 172.21.15.57:0/956805854 <== mon.0 v2:172.21.15.57:3300/0 8 ==== osd_map(693..693 src has 395..693) ==== 628+0+0 (crc 0 0 0) 0x7fca84009a80 con 0x1954f40 2024-04-24T02:05:53.721 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:53.719+0000 7fca927fc640 1 -- 172.21.15.57:0/956805854 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=694}) -- 0x7fca7403dce0 con 0x1954f40 2024-04-24T02:05:53.721 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:53.719+0000 7fca927fc640 1 -- 172.21.15.57:0/956805854 --> v2:172.21.15.57:6801/2208289758 -- osd_op(unknown.0.0:1 200.5 200:b9ff7440:::onemore:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e693) -- 0x7fca7403df30 con 0x1956050 2024-04-24T02:05:54.031 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.028+0000 7fca9a59c640 1 -- 172.21.15.57:0/956805854 <== osd.0 v2:172.21.15.57:6801/2208289758 1 ==== osd_op_reply(1 onemore [writefull 0~11876] v693'2 uv2 ondisk = 0) ==== 151+0+0 (crc 0 0 0) 0x7fca8c00a430 con 0x1956050 2024-04-24T02:05:54.032 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.028+0000 7fcaa18fcec0 1 -- 172.21.15.57:0/956805854 >> v2:172.21.15.57:6801/2208289758 conn(0x1956050 msgr2=0x1a82fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:54.032 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.028+0000 7fcaa18fcec0 1 --2- 172.21.15.57:0/956805854 >> v2:172.21.15.57:6801/2208289758 conn(0x1956050 0x1a82fb0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:54.032 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.028+0000 7fcaa18fcec0 1 -- 172.21.15.57:0/956805854 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fca740371c0 msgr2=0x7fca740396d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:54.032 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.028+0000 7fcaa18fcec0 1 --2- 172.21.15.57:0/956805854 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fca740371c0 0x7fca740396d0 crc :-1 s=READY pgs=3932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:54.032 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.028+0000 7fcaa18fcec0 1 -- 172.21.15.57:0/956805854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1954f40 msgr2=0x193dc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:54.033 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.028+0000 7fcaa18fcec0 1 --2- 172.21.15.57:0/956805854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1954f40 0x193dc00 crc :-1 s=READY pgs=12873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:54.033 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.028+0000 7fcaa18fcec0 1 -- 172.21.15.57:0/956805854 shutdown_connections 2024-04-24T02:05:54.033 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.028+0000 7fcaa18fcec0 1 --2- 172.21.15.57:0/956805854 >> v2:172.21.15.57:6801/2208289758 conn(0x1956050 0x1a82fb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:54.033 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.028+0000 7fcaa18fcec0 1 --2- 172.21.15.57:0/956805854 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fca740371c0 0x7fca740396d0 unknown :-1 s=CLOSED pgs=3932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:54.033 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.028+0000 7fcaa18fcec0 1 --2- 172.21.15.57:0/956805854 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1954f40 0x193dc00 unknown :-1 s=CLOSED pgs=12873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:54.034 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.028+0000 7fcaa18fcec0 1 -- 172.21.15.57:0/956805854 >> 172.21.15.57:0/956805854 conn(0x1873960 msgr2=0x195a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:54.034 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.028+0000 7fcaa18fcec0 1 -- 172.21.15.57:0/956805854 shutdown_connections 2024-04-24T02:05:54.034 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.029+0000 7fcaa18fcec0 1 -- 172.21.15.57:0/956805854 wait complete. 2024-04-24T02:05:54.035 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -ne 0 ']' 2024-04-24T02:05:54.035 INFO:tasks.workunit.client.0.smithi057.stderr:+ true 2024-04-24T02:05:54.035 INFO:tasks.workunit.client.0.smithi057.stderr:+ rados -p 319496fe-d53f-40fe-a120-83451e8717ac put twomore /etc/passwd 2024-04-24T02:05:54.069 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.068+0000 7f4dd5a2dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:54.075 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.074+0000 7f4dd5a2dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:54.075 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.074+0000 7f4dd5a2dec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:54.076 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.075+0000 7f4dd5a2dec0 1 Processor -- start 2024-04-24T02:05:54.076 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.075+0000 7f4dd5a2dec0 1 -- start start 2024-04-24T02:05:54.079 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.076+0000 7f4dd5a2dec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a5eab0 0x1a60970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:54.079 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.076+0000 7f4dd5a2dec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x1931950 con 0x1a5eab0 2024-04-24T02:05:54.079 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.076+0000 7f4dcd39a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a5eab0 0x1a60970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:54.079 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.076+0000 7f4dcd39a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a5eab0 0x1a60970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40552/0 (socket says 172.21.15.57:40552) 2024-04-24T02:05:54.079 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.076+0000 7f4dcd39a640 1 -- 172.21.15.57:0/191702766 learned_addr learned my addr 172.21.15.57:0/191702766 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:05:54.079 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.077+0000 7f4dcd39a640 1 -- 172.21.15.57:0/191702766 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x18d01e0 con 0x1a5eab0 2024-04-24T02:05:54.079 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.077+0000 7f4dcd39a640 1 --2- 172.21.15.57:0/191702766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a5eab0 0x1a60970 crc :-1 s=READY pgs=12879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d6cb6d8830000b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:54.079 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.077+0000 7f4dbf7fe640 1 -- 172.21.15.57:0/191702766 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4dc400c490 con 0x1a5eab0 2024-04-24T02:05:54.080 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.077+0000 7f4dbf7fe640 1 -- 172.21.15.57:0/191702766 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4dc400c5f0 con 0x1a5eab0 2024-04-24T02:05:54.080 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.077+0000 7f4dbf7fe640 1 -- 172.21.15.57:0/191702766 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4dc400c890 con 0x1a5eab0 2024-04-24T02:05:54.080 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.077+0000 7f4dd5a2dec0 1 -- 172.21.15.57:0/191702766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a5eab0 msgr2=0x1a60970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:54.080 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.077+0000 7f4dd5a2dec0 1 --2- 172.21.15.57:0/191702766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a5eab0 0x1a60970 crc :-1 s=READY pgs=12879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:54.080 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.077+0000 7f4dd5a2dec0 1 -- 172.21.15.57:0/191702766 shutdown_connections 2024-04-24T02:05:54.080 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.077+0000 7f4dd5a2dec0 1 --2- 172.21.15.57:0/191702766 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a5eab0 0x1a60970 unknown :-1 s=CLOSED pgs=12879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:54.080 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.077+0000 7f4dd5a2dec0 1 -- 172.21.15.57:0/191702766 >> 172.21.15.57:0/191702766 conn(0x18e8960 msgr2=0x1a5c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:54.080 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.078+0000 7f4dd5a2dec0 1 -- 172.21.15.57:0/191702766 shutdown_connections 2024-04-24T02:05:54.080 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.078+0000 7f4dd5a2dec0 1 -- 172.21.15.57:0/191702766 wait complete. 2024-04-24T02:05:54.081 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.078+0000 7f4dd5a2dec0 1 Processor -- start 2024-04-24T02:05:54.081 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.079+0000 7f4dd5a2dec0 1 -- start start 2024-04-24T02:05:54.082 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.080+0000 7f4dd5a2dec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a5eab0 0x1a49270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:54.082 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.080+0000 7f4dd5a2dec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x192f3d0 con 0x1a5eab0 2024-04-24T02:05:54.082 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.080+0000 7f4dcd39a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a5eab0 0x1a49270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:54.082 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.080+0000 7f4dcd39a640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a5eab0 0x1a49270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40564/0 (socket says 172.21.15.57:40564) 2024-04-24T02:05:54.082 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.080+0000 7f4dcd39a640 1 -- 172.21.15.57:0/1824261799 learned_addr learned my addr 172.21.15.57:0/1824261799 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:05:54.082 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.080+0000 7f4dcd39a640 1 -- 172.21.15.57:0/1824261799 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x18c2e30 con 0x1a5eab0 2024-04-24T02:05:54.083 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.081+0000 7f4dcd39a640 1 --2- 172.21.15.57:0/1824261799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a5eab0 0x1a49270 crc :-1 s=READY pgs=12880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:54.083 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.081+0000 7f4dbe7fc640 1 -- 172.21.15.57:0/1824261799 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4dc4016040 con 0x1a5eab0 2024-04-24T02:05:54.083 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.081+0000 7f4dbe7fc640 1 -- 172.21.15.57:0/1824261799 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f4dc40118d0 con 0x1a5eab0 2024-04-24T02:05:54.083 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.081+0000 7f4dbe7fc640 1 -- 172.21.15.57:0/1824261799 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f4dc4011b70 con 0x1a5eab0 2024-04-24T02:05:54.083 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.081+0000 7f4dd5a2dec0 1 -- 172.21.15.57:0/1824261799 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x18c2890 con 0x1a5eab0 2024-04-24T02:05:54.083 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.081+0000 7f4dd5a2dec0 1 -- 172.21.15.57:0/1824261799 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1a4c670 con 0x1a5eab0 2024-04-24T02:05:54.084 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.082+0000 7f4dbe7fc640 1 -- 172.21.15.57:0/1824261799 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f4dc400e440 con 0x1a5eab0 2024-04-24T02:05:54.084 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.082+0000 7f4dbe7fc640 1 --2- 172.21.15.57:0/1824261799 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f4dac0371c0 0x7f4dac0396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:54.085 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.082+0000 7f4dbe7fc640 1 -- 172.21.15.57:0/1824261799 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(693..693 src has 395..693) ==== 3791+0+0 (crc 0 0 0) 0x7f4dc4048f00 con 0x1a5eab0 2024-04-24T02:05:54.085 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.082+0000 7f4dd5a2dec0 1 --2- 172.21.15.57:0/1824261799 >> v2:172.21.15.57:6805/2600611357 conn(0x1a618f0 0x1a49cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:54.085 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.082+0000 7f4dd5a2dec0 1 -- 172.21.15.57:0/1824261799 --> v2:172.21.15.57:6805/2600611357 -- osd_op(unknown.0.0:1 200.6 200:7019d845:::twomore:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e693) -- 0x1af3ae0 con 0x1a618f0 2024-04-24T02:05:54.086 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.082+0000 7f4dccb99640 1 --2- 172.21.15.57:0/1824261799 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f4dac0371c0 0x7f4dac0396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:54.086 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.083+0000 7f4dccb99640 1 --2- 172.21.15.57:0/1824261799 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f4dac0371c0 0x7f4dac0396d0 crc :-1 s=READY pgs=3934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:54.086 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.083+0000 7f4dcdb9b640 1 --2- 172.21.15.57:0/1824261799 >> v2:172.21.15.57:6805/2600611357 conn(0x1a618f0 0x1a49cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T02:05:54.088 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.087+0000 7f4dcdb9b640 1 --2- 172.21.15.57:0/1824261799 >> v2:172.21.15.57:6805/2600611357 conn(0x1a618f0 0x1a49cc0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:54.103 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.101+0000 7f4dcdb9b640 1 -- 172.21.15.57:0/1824261799 <== osd.1 v2:172.21.15.57:6805/2600611357 1 ==== osd_op_reply(1 twomore [writefull 0~11876] v693'1 uv1 ondisk = 0) ==== 151+0+0 (crc 0 0 0) 0x7f4dc000a430 con 0x1a618f0 2024-04-24T02:05:54.104 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.101+0000 7f4dd5a2dec0 1 -- 172.21.15.57:0/1824261799 >> v2:172.21.15.57:6805/2600611357 conn(0x1a618f0 msgr2=0x1a49cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:54.104 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.101+0000 7f4dd5a2dec0 1 --2- 172.21.15.57:0/1824261799 >> v2:172.21.15.57:6805/2600611357 conn(0x1a618f0 0x1a49cc0 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:54.104 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.101+0000 7f4dd5a2dec0 1 -- 172.21.15.57:0/1824261799 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f4dac0371c0 msgr2=0x7f4dac0396d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:54.104 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.101+0000 7f4dd5a2dec0 1 --2- 172.21.15.57:0/1824261799 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f4dac0371c0 0x7f4dac0396d0 crc :-1 s=READY pgs=3934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:54.104 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.101+0000 7f4dd5a2dec0 1 -- 172.21.15.57:0/1824261799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a5eab0 msgr2=0x1a49270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:54.104 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.101+0000 7f4dd5a2dec0 1 --2- 172.21.15.57:0/1824261799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a5eab0 0x1a49270 crc :-1 s=READY pgs=12880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:54.104 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.101+0000 7f4dd5a2dec0 1 -- 172.21.15.57:0/1824261799 shutdown_connections 2024-04-24T02:05:54.104 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.101+0000 7f4dd5a2dec0 1 --2- 172.21.15.57:0/1824261799 >> v2:172.21.15.57:6805/2600611357 conn(0x1a618f0 0x1a49cc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:54.104 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.101+0000 7f4dd5a2dec0 1 --2- 172.21.15.57:0/1824261799 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f4dac0371c0 0x7f4dac0396d0 unknown :-1 s=CLOSED pgs=3934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:54.104 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.101+0000 7f4dd5a2dec0 1 --2- 172.21.15.57:0/1824261799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a5eab0 0x1a49270 unknown :-1 s=CLOSED pgs=12880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:54.104 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.101+0000 7f4dd5a2dec0 1 -- 172.21.15.57:0/1824261799 >> 172.21.15.57:0/1824261799 conn(0x18e8960 msgr2=0x1a5c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:54.104 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.102+0000 7f4dd5a2dec0 1 -- 172.21.15.57:0/1824261799 shutdown_connections 2024-04-24T02:05:54.104 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.102+0000 7f4dd5a2dec0 1 -- 172.21.15.57:0/1824261799 wait complete. 2024-04-24T02:05:54.105 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph osd pool set-quota 319496fe-d53f-40fe-a120-83451e8717ac max_bytes 100 2024-04-24T02:05:54.203 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.195+0000 7f248deed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:54.204 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.203+0000 7f248deed640 1 Processor -- start 2024-04-24T02:05:54.204 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.203+0000 7f248deed640 1 -- start start 2024-04-24T02:05:54.207 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.205+0000 7f248deed640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2488135c20 0x7f2488138040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:54.207 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.205+0000 7f248deed640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2488072ff0 con 0x7f248812c650 2024-04-24T02:05:54.207 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.205+0000 7f248deed640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f2488073c50 con 0x7f2488135c20 2024-04-24T02:05:54.207 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.205+0000 7f24877fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f248812c650 0x7f248812ca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49788/0 (socket says 172.21.15.57:49788) 2024-04-24T02:05:54.207 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.205+0000 7f24877fe640 1 -- 172.21.15.57:0/476962547 learned_addr learned my addr 172.21.15.57:0/476962547 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T02:05:54.207 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.205+0000 7f2486ffd640 1 --2- 172.21.15.57:0/476962547 >> v2:172.21.15.57:3300/0 conn(0x7f2488135c20 0x7f2488138040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:54.207 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.205+0000 7f24867fc640 1 -- 172.21.15.57:0/476962547 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2861531739 0 0) 0x7f2488072ff0 con 0x7f248812c650 2024-04-24T02:05:54.207 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.205+0000 7f24867fc640 1 -- 172.21.15.57:0/476962547 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2470003580 con 0x7f248812c650 2024-04-24T02:05:54.207 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.205+0000 7f2486ffd640 1 -- 172.21.15.57:0/476962547 >> v1:172.21.15.57:6789/0 conn(0x7f248812c650 legacy=0x7f248812ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:54.208 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.205+0000 7f2486ffd640 1 -- 172.21.15.57:0/476962547 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2488072790 con 0x7f2488135c20 2024-04-24T02:05:54.208 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.206+0000 7f2486ffd640 1 --2- 172.21.15.57:0/476962547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2488135c20 0x7f2488138040 crc :-1 s=READY pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95e0a96949ccdec server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:54.208 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.206+0000 7f24867fc640 1 -- 172.21.15.57:0/476962547 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f247c009d90 con 0x7f2488135c20 2024-04-24T02:05:54.208 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.206+0000 7f24867fc640 1 -- 172.21.15.57:0/476962547 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f247c00e230 con 0x7f2488135c20 2024-04-24T02:05:54.208 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.206+0000 7f24867fc640 1 -- 172.21.15.57:0/476962547 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f247c00e4d0 con 0x7f2488135c20 2024-04-24T02:05:54.209 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.206+0000 7f248deed640 1 -- 172.21.15.57:0/476962547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2488135c20 msgr2=0x7f2488138040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:54.209 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.206+0000 7f248deed640 1 --2- 172.21.15.57:0/476962547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2488135c20 0x7f2488138040 crc :-1 s=READY pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:54.209 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.206+0000 7f248deed640 1 -- 172.21.15.57:0/476962547 shutdown_connections 2024-04-24T02:05:54.209 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.206+0000 7f248deed640 1 --2- 172.21.15.57:0/476962547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2488135c20 0x7f2488138040 unknown :-1 s=CLOSED pgs=12882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:54.209 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.206+0000 7f248deed640 1 -- 172.21.15.57:0/476962547 >> 172.21.15.57:0/476962547 conn(0x7f24880a1b10 msgr2=0x7f24880a1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:54.209 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.206+0000 7f248deed640 1 -- 172.21.15.57:0/476962547 shutdown_connections 2024-04-24T02:05:54.209 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.206+0000 7f248deed640 1 -- 172.21.15.57:0/476962547 wait complete. 2024-04-24T02:05:54.209 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.207+0000 7f248deed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:05:54.210 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.208+0000 7f248deed640 1 Processor -- start 2024-04-24T02:05:54.210 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.209+0000 7f248deed640 1 -- start start 2024-04-24T02:05:54.212 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.210+0000 7f248deed640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f248812c650 0x7f24881c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:54.212 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.210+0000 7f248deed640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f24881c73b0 con 0x7f248812c650 2024-04-24T02:05:54.212 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.210+0000 7f24877fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f248812c650 0x7f24881c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:54.212 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.210+0000 7f24877fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f248812c650 0x7f24881c79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:40580/0 (socket says 172.21.15.57:40580) 2024-04-24T02:05:54.212 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.210+0000 7f24877fe640 1 -- 172.21.15.57:0/1576430622 learned_addr learned my addr 172.21.15.57:0/1576430622 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:05:54.213 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.210+0000 7f24877fe640 1 -- 172.21.15.57:0/1576430622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f248811b360 con 0x7f248812c650 2024-04-24T02:05:54.213 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.211+0000 7f24877fe640 1 --2- 172.21.15.57:0/1576430622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f248812c650 0x7f24881c79f0 crc :-1 s=READY pgs=12883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:54.213 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.211+0000 7f246ffff640 1 -- 172.21.15.57:0/1576430622 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2478005a60 con 0x7f248812c650 2024-04-24T02:05:54.213 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.211+0000 7f246ffff640 1 -- 172.21.15.57:0/1576430622 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f2478005bc0 con 0x7f248812c650 2024-04-24T02:05:54.213 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.211+0000 7f248deed640 1 -- 172.21.15.57:0/1576430622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24881c7650 con 0x7f248812c650 2024-04-24T02:05:54.213 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.211+0000 7f246ffff640 1 -- 172.21.15.57:0/1576430622 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f2478005e60 con 0x7f248812c650 2024-04-24T02:05:54.213 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.211+0000 7f248deed640 1 -- 172.21.15.57:0/1576430622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f248811b760 con 0x7f248812c650 2024-04-24T02:05:54.214 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.212+0000 7f248deed640 1 -- 172.21.15.57:0/1576430622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f248811b4f0 con 0x7f248812c650 2024-04-24T02:05:54.214 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.212+0000 7f246ffff640 1 -- 172.21.15.57:0/1576430622 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f247800c7a0 con 0x7f248812c650 2024-04-24T02:05:54.214 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.212+0000 7f246ffff640 1 --2- 172.21.15.57:0/1576430622 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f2474038980 0x7f247403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:05:54.214 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.212+0000 7f246ffff640 1 -- 172.21.15.57:0/1576430622 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(693..693 src has 395..693) ==== 3791+0+0 (crc 0 0 0) 0x7f2478048610 con 0x7f248812c650 2024-04-24T02:05:54.214 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.212+0000 7f2486ffd640 1 --2- 172.21.15.57:0/1576430622 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f2474038980 0x7f247403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:05:54.214 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.213+0000 7f2486ffd640 1 --2- 172.21.15.57:0/1576430622 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f2474038980 0x7f247403ae90 crc :-1 s=READY pgs=3935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:05:54.218 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.217+0000 7f246ffff640 1 -- 172.21.15.57:0/1576430622 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f247800d4d0 con 0x7f248812c650 2024-04-24T02:05:54.407 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.405+0000 7f248deed640 1 -- 172.21.15.57:0/1576430622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "field": "max_bytes", "val": "100"} v 0) -- 0x7f2488069870 con 0x7f248812c650 2024-04-24T02:05:54.839 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.837+0000 7f246ffff640 1 -- 172.21.15.57:0/1576430622 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 319496fe-d53f-40fe-a120-83451e8717ac v694) ==== 221+0+0 (crc 0 0 0) 0x7f247800d4d0 con 0x7f248812c650 2024-04-24T02:05:54.951 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:54.949+0000 7f248deed640 1 -- 172.21.15.57:0/1576430622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "field": "max_bytes", "val": "100"} v 0) -- 0x7f248809ef70 con 0x7f248812c650 2024-04-24T02:05:55.857 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:55.856+0000 7f246ffff640 1 -- 172.21.15.57:0/1576430622 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 319496fe-d53f-40fe-a120-83451e8717ac v695) ==== 221+0+0 (crc 0 0 0) 0x7f247800fdf0 con 0x7f248812c650 2024-04-24T02:05:55.857 INFO:tasks.workunit.client.0.smithi057.stderr:set-quota max_bytes = 100 for pool 319496fe-d53f-40fe-a120-83451e8717ac 2024-04-24T02:05:55.861 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:55.860+0000 7f248deed640 1 -- 172.21.15.57:0/1576430622 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f2474038980 msgr2=0x7f247403ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:55.862 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:55.860+0000 7f248deed640 1 --2- 172.21.15.57:0/1576430622 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f2474038980 0x7f247403ae90 crc :-1 s=READY pgs=3935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:55.862 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:55.860+0000 7f248deed640 1 -- 172.21.15.57:0/1576430622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f248812c650 msgr2=0x7f24881c79f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:05:55.862 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:55.860+0000 7f248deed640 1 --2- 172.21.15.57:0/1576430622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f248812c650 0x7f24881c79f0 crc :-1 s=READY pgs=12883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:55.862 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:55.861+0000 7f248deed640 1 -- 172.21.15.57:0/1576430622 shutdown_connections 2024-04-24T02:05:55.862 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:55.861+0000 7f248deed640 1 --2- 172.21.15.57:0/1576430622 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f2474038980 0x7f247403ae90 unknown :-1 s=CLOSED pgs=3935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:55.862 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:55.861+0000 7f248deed640 1 --2- 172.21.15.57:0/1576430622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f248812c650 0x7f24881c79f0 unknown :-1 s=CLOSED pgs=12883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:05:55.865 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:55.861+0000 7f248deed640 1 -- 172.21.15.57:0/1576430622 >> 172.21.15.57:0/1576430622 conn(0x7f24880a1b10 msgr2=0x7f248812f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:05:55.865 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:55.861+0000 7f248deed640 1 -- 172.21.15.57:0/1576430622 shutdown_connections 2024-04-24T02:05:55.866 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:05:55.861+0000 7f248deed640 1 -- 172.21.15.57:0/1576430622 wait complete. 2024-04-24T02:05:55.875 INFO:tasks.workunit.client.0.smithi057.stderr:+ sleep 30 2024-04-24T02:06:25.878 INFO:tasks.workunit.client.0.smithi057.stderr:+ pid=96642 2024-04-24T02:06:25.878 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph osd pool set-quota 319496fe-d53f-40fe-a120-83451e8717ac max_bytes 0 2024-04-24T02:06:25.878 INFO:tasks.workunit.client.0.smithi057.stderr:+ rados -p 319496fe-d53f-40fe-a120-83451e8717ac put two /etc/passwd 2024-04-24T02:06:25.923 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.923+0000 7fbac78ceec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:06:25.930 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.930+0000 7fbac78ceec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:06:25.930 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.930+0000 7fbac78ceec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:06:25.931 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.931+0000 7fbac78ceec0 1 Processor -- start 2024-04-24T02:06:25.931 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.931+0000 7fbac78ceec0 1 -- start start 2024-04-24T02:06:25.933 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.932+0000 7fbac78ceec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x23ac050 0x23a79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:06:25.933 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.932+0000 7fbac78ceec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x2312950 con 0x23ac050 2024-04-24T02:06:25.933 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.932+0000 7fbabaffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x23ac050 0x23a79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:06:25.933 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.933+0000 7fbabaffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x23ac050 0x23a79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54896/0 (socket says 172.21.15.57:54896) 2024-04-24T02:06:25.933 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.933+0000 7fbabaffd640 1 -- 172.21.15.57:0/1798219614 learned_addr learned my addr 172.21.15.57:0/1798219614 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:06:25.933 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.933+0000 7fbabaffd640 1 -- 172.21.15.57:0/1798219614 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x22b11e0 con 0x23ac050 2024-04-24T02:06:25.934 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.933+0000 7fbabaffd640 1 --2- 172.21.15.57:0/1798219614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x23ac050 0x23a79f0 crc :-1 s=READY pgs=12886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cbf5b2c5af9d828 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:06:25.934 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.933+0000 7fbab97fa640 1 -- 172.21.15.57:0/1798219614 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbaac032040 con 0x23ac050 2024-04-24T02:06:25.934 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.933+0000 7fbab97fa640 1 -- 172.21.15.57:0/1798219614 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbaac00a170 con 0x23ac050 2024-04-24T02:06:25.934 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.933+0000 7fbab97fa640 1 -- 172.21.15.57:0/1798219614 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbaac02cb40 con 0x23ac050 2024-04-24T02:06:25.935 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.934+0000 7fbac78ceec0 1 -- 172.21.15.57:0/1798219614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x23ac050 msgr2=0x23a79f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:06:25.935 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.934+0000 7fbac78ceec0 1 --2- 172.21.15.57:0/1798219614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x23ac050 0x23a79f0 crc :-1 s=READY pgs=12886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:25.935 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.934+0000 7fbac78ceec0 1 -- 172.21.15.57:0/1798219614 shutdown_connections 2024-04-24T02:06:25.935 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.934+0000 7fbac78ceec0 1 --2- 172.21.15.57:0/1798219614 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x23ac050 0x23a79f0 unknown :-1 s=CLOSED pgs=12886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:25.935 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.934+0000 7fbac78ceec0 1 -- 172.21.15.57:0/1798219614 >> 172.21.15.57:0/1798219614 conn(0x22c9960 msgr2=0x24c54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:06:25.935 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.934+0000 7fbac78ceec0 1 -- 172.21.15.57:0/1798219614 shutdown_connections 2024-04-24T02:06:25.935 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.935+0000 7fbac78ceec0 1 -- 172.21.15.57:0/1798219614 wait complete. 2024-04-24T02:06:25.936 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.936+0000 7fbac78ceec0 1 Processor -- start 2024-04-24T02:06:25.936 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.936+0000 7fbac78ceec0 1 -- start start 2024-04-24T02:06:25.938 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.937+0000 7fbac78ceec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x23ac050 0x243dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:06:25.938 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.937+0000 7fbac78ceec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x23103d0 con 0x23ac050 2024-04-24T02:06:25.938 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.938+0000 7fbabaffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x23ac050 0x243dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:06:25.938 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.938+0000 7fbabaffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x23ac050 0x243dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54902/0 (socket says 172.21.15.57:54902) 2024-04-24T02:06:25.938 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.938+0000 7fbabaffd640 1 -- 172.21.15.57:0/650016758 learned_addr learned my addr 172.21.15.57:0/650016758 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:06:25.938 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.938+0000 7fbabaffd640 1 -- 172.21.15.57:0/650016758 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x22a3e30 con 0x23ac050 2024-04-24T02:06:25.939 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.938+0000 7fbabaffd640 1 --2- 172.21.15.57:0/650016758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x23ac050 0x243dd70 crc :-1 s=READY pgs=12887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:06:25.939 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.938+0000 7fbaa3fff640 1 -- 172.21.15.57:0/650016758 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbaac032040 con 0x23ac050 2024-04-24T02:06:25.940 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.938+0000 7fbaa3fff640 1 -- 172.21.15.57:0/650016758 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fbaac02c580 con 0x23ac050 2024-04-24T02:06:25.940 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.938+0000 7fbac78ceec0 1 -- 172.21.15.57:0/650016758 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x22a3890 con 0x23ac050 2024-04-24T02:06:25.940 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.938+0000 7fbaa3fff640 1 -- 172.21.15.57:0/650016758 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fbaac00a2e0 con 0x23ac050 2024-04-24T02:06:25.940 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.939+0000 7fbac78ceec0 1 -- 172.21.15.57:0/650016758 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x2394360 con 0x23ac050 2024-04-24T02:06:25.940 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.940+0000 7fbaa3fff640 1 -- 172.21.15.57:0/650016758 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fbaac02dc70 con 0x23ac050 2024-04-24T02:06:25.941 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.940+0000 7fbaa3fff640 1 --2- 172.21.15.57:0/650016758 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fbaa80371c0 0x7fbaa80396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:06:25.941 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.940+0000 7fbaa3fff640 1 -- 172.21.15.57:0/650016758 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(696..696 src has 395..696) ==== 3791+0+0 (crc 0 0 0) 0x7fbaac06b720 con 0x23ac050 2024-04-24T02:06:25.941 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.940+0000 7fbaa3fff640 1 -- 172.21.15.57:0/650016758 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=697}) -- 0x7fbaa803d3d0 con 0x23ac050 2024-04-24T02:06:25.941 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.940+0000 7fbac78ceec0 1 --2- 172.21.15.57:0/650016758 >> v2:172.21.15.57:6805/2600611357 conn(0x23ace20 0x23931d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:06:25.941 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.940+0000 7fbaba7fc640 1 --2- 172.21.15.57:0/650016758 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fbaa80371c0 0x7fbaa80396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:06:25.941 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.941+0000 7fbaba7fc640 1 --2- 172.21.15.57:0/650016758 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fbaa80371c0 0x7fbaa80396d0 crc :-1 s=READY pgs=3936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:06:25.941 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.941+0000 7fbabb7fe640 1 --2- 172.21.15.57:0/650016758 >> v2:172.21.15.57:6805/2600611357 conn(0x23ace20 0x23931d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T02:06:25.944 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.944+0000 7fbabb7fe640 1 --2- 172.21.15.57:0/650016758 >> v2:172.21.15.57:6805/2600611357 conn(0x23ace20 0x23931d0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:06:25.987 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.978+0000 7fda2bb5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:06:25.988 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.988+0000 7fda2bb5d640 1 Processor -- start 2024-04-24T02:06:25.988 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.988+0000 7fda2bb5d640 1 -- start start 2024-04-24T02:06:25.991 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.989+0000 7fda2bb5d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fda24135060 0x7fda24135470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:06:25.991 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.990+0000 7fda2bb5d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda241359b0 con 0x7fda240a25b0 2024-04-24T02:06:25.991 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.990+0000 7fda2bb5d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fda2409be70 con 0x7fda24135060 2024-04-24T02:06:25.991 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.990+0000 7fda298f9640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fda24135060 0x7fda24135470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:06:25.991 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.990+0000 7fda290f8640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fda240a25b0 0x7fda240a29c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:38692/0 (socket says 172.21.15.57:38692) 2024-04-24T02:06:25.991 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.990+0000 7fda298f9640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fda24135060 0x7fda24135470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54912/0 (socket says 172.21.15.57:54912) 2024-04-24T02:06:25.991 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.990+0000 7fda290f8640 1 -- 172.21.15.57:0/852953153 learned_addr learned my addr 172.21.15.57:0/852953153 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T02:06:25.991 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.990+0000 7fda298f9640 1 -- 172.21.15.57:0/852953153 >> v1:172.21.15.57:6789/0 conn(0x7fda240a25b0 legacy=0x7fda240a29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:06:25.991 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.990+0000 7fda298f9640 1 -- 172.21.15.57:0/852953153 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda24134c30 con 0x7fda24135060 2024-04-24T02:06:25.991 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.990+0000 7fda298f9640 1 --2- 172.21.15.57:0/852953153 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda24135060 0x7fda24135470 crc :-1 s=READY pgs=12889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e41e3c9969dae16 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:06:25.991 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.990+0000 7fda288f7640 1 -- 172.21.15.57:0/852953153 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fda20009d90 con 0x7fda24135060 2024-04-24T02:06:25.991 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.990+0000 7fda288f7640 1 -- 172.21.15.57:0/852953153 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fda2000e230 con 0x7fda24135060 2024-04-24T02:06:25.992 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.990+0000 7fda288f7640 1 -- 172.21.15.57:0/852953153 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fda2000e4d0 con 0x7fda24135060 2024-04-24T02:06:25.993 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.991+0000 7fda2bb5d640 1 -- 172.21.15.57:0/852953153 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda24135060 msgr2=0x7fda24135470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:06:25.993 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.991+0000 7fda2bb5d640 1 --2- 172.21.15.57:0/852953153 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda24135060 0x7fda24135470 crc :-1 s=READY pgs=12889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:25.993 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.991+0000 7fda2bb5d640 1 -- 172.21.15.57:0/852953153 shutdown_connections 2024-04-24T02:06:25.993 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.991+0000 7fda2bb5d640 1 --2- 172.21.15.57:0/852953153 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda24135060 0x7fda24135470 unknown :-1 s=CLOSED pgs=12889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:25.993 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.991+0000 7fda2bb5d640 1 -- 172.21.15.57:0/852953153 >> 172.21.15.57:0/852953153 conn(0x7fda2406d420 msgr2=0x7fda2406d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:06:25.994 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.991+0000 7fda2bb5d640 1 -- 172.21.15.57:0/852953153 shutdown_connections 2024-04-24T02:06:25.994 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.991+0000 7fda2bb5d640 1 -- 172.21.15.57:0/852953153 wait complete. 2024-04-24T02:06:25.994 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.992+0000 7fda2bb5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:06:25.994 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.993+0000 7fda2bb5d640 1 Processor -- start 2024-04-24T02:06:25.994 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.993+0000 7fda2bb5d640 1 -- start start 2024-04-24T02:06:25.996 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.995+0000 7fda2bb5d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda240a25b0 0x7fda2409e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:06:25.996 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.995+0000 7fda2bb5d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fda2411d3f0 con 0x7fda240a25b0 2024-04-24T02:06:25.996 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.995+0000 7fda298f9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda240a25b0 0x7fda2409e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:06:25.996 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.995+0000 7fda298f9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda240a25b0 0x7fda2409e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54914/0 (socket says 172.21.15.57:54914) 2024-04-24T02:06:25.996 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.995+0000 7fda298f9640 1 -- 172.21.15.57:0/1552670432 learned_addr learned my addr 172.21.15.57:0/1552670432 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:06:25.996 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.995+0000 7fda298f9640 1 -- 172.21.15.57:0/1552670432 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda240a0350 con 0x7fda240a25b0 2024-04-24T02:06:25.996 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.995+0000 7fda298f9640 1 --2- 172.21.15.57:0/1552670432 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda240a25b0 0x7fda2409e6f0 crc :-1 s=READY pgs=12890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:06:25.996 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.995+0000 7fda167fc640 1 -- 172.21.15.57:0/1552670432 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fda20014540 con 0x7fda240a25b0 2024-04-24T02:06:25.996 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.995+0000 7fda167fc640 1 -- 172.21.15.57:0/1552670432 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fda200146a0 con 0x7fda240a25b0 2024-04-24T02:06:25.996 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.995+0000 7fda167fc640 1 -- 172.21.15.57:0/1552670432 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fda20014940 con 0x7fda240a25b0 2024-04-24T02:06:25.996 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.996+0000 7fda2bb5d640 1 -- 172.21.15.57:0/1552670432 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda2412ee40 con 0x7fda240a25b0 2024-04-24T02:06:25.996 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.996+0000 7fda2bb5d640 1 -- 172.21.15.57:0/1552670432 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda2411dab0 con 0x7fda240a25b0 2024-04-24T02:06:25.997 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.997+0000 7fda167fc640 1 -- 172.21.15.57:0/1552670432 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fda20014af0 con 0x7fda240a25b0 2024-04-24T02:06:25.997 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.997+0000 7fda2bb5d640 1 -- 172.21.15.57:0/1552670432 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda2409fc20 con 0x7fda240a25b0 2024-04-24T02:06:25.997 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.997+0000 7fda167fc640 1 --2- 172.21.15.57:0/1552670432 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fda08038980 0x7fda0803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:06:25.998 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.997+0000 7fda167fc640 1 -- 172.21.15.57:0/1552670432 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(696..696 src has 395..696) ==== 3791+0+0 (crc 0 0 0) 0x7fda20019040 con 0x7fda240a25b0 2024-04-24T02:06:25.998 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.997+0000 7fda167fc640 1 -- 172.21.15.57:0/1552670432 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=697}) -- 0x7fda0803eb90 con 0x7fda240a25b0 2024-04-24T02:06:25.998 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.997+0000 7fda290f8640 1 --2- 172.21.15.57:0/1552670432 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fda08038980 0x7fda0803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:06:25.998 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:25.998+0000 7fda290f8640 1 --2- 172.21.15.57:0/1552670432 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fda08038980 0x7fda0803ae90 crc :-1 s=READY pgs=3937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:06:26.002 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:26.002+0000 7fda167fc640 1 -- 172.21.15.57:0/1552670432 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fda20018190 con 0x7fda240a25b0 2024-04-24T02:06:26.194 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:26.194+0000 7fda2bb5d640 1 -- 172.21.15.57:0/1552670432 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "field": "max_bytes", "val": "0"} v 0) -- 0x7fda2411ef80 con 0x7fda240a25b0 2024-04-24T02:06:26.740 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:26.740+0000 7fda167fc640 1 -- 172.21.15.57:0/1552670432 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 319496fe-d53f-40fe-a120-83451e8717ac v697) ==== 217+0+0 (crc 0 0 0) 0x7fda2000fb30 con 0x7fda240a25b0 2024-04-24T02:06:26.741 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:26.740+0000 7fda167fc640 1 -- 172.21.15.57:0/1552670432 <== mon.0 v2:172.21.15.57:3300/0 8 ==== osd_map(697..697 src has 395..697) ==== 628+0+0 (crc 0 0 0) 0x7fda20010310 con 0x7fda240a25b0 2024-04-24T02:06:26.741 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:26.740+0000 7fbaa3fff640 1 -- 172.21.15.57:0/650016758 <== mon.0 v2:172.21.15.57:3300/0 6 ==== osd_map(697..697 src has 395..697) ==== 628+0+0 (crc 0 0 0) 0x7fbaac037d40 con 0x23ac050 2024-04-24T02:06:26.741 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:26.740+0000 7fda167fc640 1 -- 172.21.15.57:0/1552670432 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=698}) -- 0x7fda0803fad0 con 0x7fda240a25b0 2024-04-24T02:06:26.741 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:26.740+0000 7fbaa3fff640 1 -- 172.21.15.57:0/650016758 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=698}) -- 0x7fbaa803da60 con 0x23ac050 2024-04-24T02:06:26.853 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:26.853+0000 7fda2bb5d640 1 -- 172.21.15.57:0/1552670432 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "field": "max_bytes", "val": "0"} v 0) -- 0x7fda2411d1f0 con 0x7fda240a25b0 2024-04-24T02:06:27.749 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.748+0000 7fda167fc640 1 -- 172.21.15.57:0/1552670432 <== mon.0 v2:172.21.15.57:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 319496fe-d53f-40fe-a120-83451e8717ac v698) ==== 217+0+0 (crc 0 0 0) 0x7fda2000fd10 con 0x7fda240a25b0 2024-04-24T02:06:27.749 INFO:tasks.workunit.client.0.smithi057.stderr:set-quota max_bytes = 0 for pool 319496fe-d53f-40fe-a120-83451e8717ac 2024-04-24T02:06:27.751 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.749+0000 7fbaa3fff640 1 -- 172.21.15.57:0/650016758 <== mon.0 v2:172.21.15.57:3300/0 7 ==== osd_map(698..698 src has 395..698) ==== 628+0+0 (crc 0 0 0) 0x7fbaac0377b0 con 0x23ac050 2024-04-24T02:06:27.751 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.749+0000 7fda167fc640 1 -- 172.21.15.57:0/1552670432 <== mon.0 v2:172.21.15.57:3300/0 10 ==== osd_map(698..698 src has 395..698) ==== 628+0+0 (crc 0 0 0) 0x7fda20014da0 con 0x7fda240a25b0 2024-04-24T02:06:27.751 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.750+0000 7fda167fc640 1 -- 172.21.15.57:0/1552670432 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=699}) -- 0x7fda0803fbf0 con 0x7fda240a25b0 2024-04-24T02:06:27.751 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.750+0000 7fbaa3fff640 1 -- 172.21.15.57:0/650016758 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=699}) -- 0x7fbaa803dc80 con 0x23ac050 2024-04-24T02:06:27.752 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.751+0000 7fda2bb5d640 1 -- 172.21.15.57:0/1552670432 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fda08038980 msgr2=0x7fda0803ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:06:27.752 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.751+0000 7fda2bb5d640 1 --2- 172.21.15.57:0/1552670432 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fda08038980 0x7fda0803ae90 crc :-1 s=READY pgs=3937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:27.752 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.751+0000 7fda2bb5d640 1 -- 172.21.15.57:0/1552670432 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda240a25b0 msgr2=0x7fda2409e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:06:27.753 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.751+0000 7fda2bb5d640 1 --2- 172.21.15.57:0/1552670432 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda240a25b0 0x7fda2409e6f0 crc :-1 s=READY pgs=12890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:27.753 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.751+0000 7fda2bb5d640 1 -- 172.21.15.57:0/1552670432 shutdown_connections 2024-04-24T02:06:27.753 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.751+0000 7fda2bb5d640 1 --2- 172.21.15.57:0/1552670432 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fda08038980 0x7fda0803ae90 unknown :-1 s=CLOSED pgs=3937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:27.753 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.751+0000 7fda2bb5d640 1 --2- 172.21.15.57:0/1552670432 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda240a25b0 0x7fda2409e6f0 unknown :-1 s=CLOSED pgs=12890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:27.753 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.751+0000 7fda2bb5d640 1 -- 172.21.15.57:0/1552670432 >> 172.21.15.57:0/1552670432 conn(0x7fda2406d420 msgr2=0x7fda241328b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:06:27.753 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.751+0000 7fda2bb5d640 1 -- 172.21.15.57:0/1552670432 shutdown_connections 2024-04-24T02:06:27.753 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.751+0000 7fda2bb5d640 1 -- 172.21.15.57:0/1552670432 wait complete. 2024-04-24T02:06:27.768 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph osd pool set-quota 319496fe-d53f-40fe-a120-83451e8717ac max_objects 0 2024-04-24T02:06:27.880 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.869+0000 7f093619d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:06:27.881 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.880+0000 7f093619d640 1 Processor -- start 2024-04-24T02:06:27.881 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.880+0000 7f093619d640 1 -- start start 2024-04-24T02:06:27.884 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.883+0000 7f093619d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0930135060 0x7f0930135470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:06:27.884 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.883+0000 7f093619d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09301359b0 con 0x7f09300a25b0 2024-04-24T02:06:27.884 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.883+0000 7f093619d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f093009be70 con 0x7f0930135060 2024-04-24T02:06:27.884 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.883+0000 7f092f7fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0930135060 0x7f0930135470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:06:27.884 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.883+0000 7f092f7fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0930135060 0x7f0930135470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54920/0 (socket says 172.21.15.57:54920) 2024-04-24T02:06:27.884 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.883+0000 7f092f7fe640 1 -- 172.21.15.57:0/848810192 learned_addr learned my addr 172.21.15.57:0/848810192 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:06:27.885 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.883+0000 7f092effd640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f09300a25b0 0x7f09300a29c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:38694/0 (socket says 172.21.15.57:38694) 2024-04-24T02:06:27.885 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.883+0000 7f092f7fe640 1 -- 172.21.15.57:0/848810192 >> v1:172.21.15.57:6789/0 conn(0x7f09300a25b0 legacy=0x7f09300a29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:06:27.885 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.883+0000 7f092f7fe640 1 -- 172.21.15.57:0/848810192 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0930134c30 con 0x7f0930135060 2024-04-24T02:06:27.886 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.883+0000 7f092f7fe640 1 --2- 172.21.15.57:0/848810192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0930135060 0x7f0930135470 crc :-1 s=READY pgs=12892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4583bd1e81dc9438 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:06:27.886 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.884+0000 7f092e7fc640 1 -- 172.21.15.57:0/848810192 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f092000e040 con 0x7f0930135060 2024-04-24T02:06:27.886 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.884+0000 7f092e7fc640 1 -- 172.21.15.57:0/848810192 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f09200091e0 con 0x7f0930135060 2024-04-24T02:06:27.886 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.884+0000 7f092e7fc640 1 -- 172.21.15.57:0/848810192 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0920007730 con 0x7f0930135060 2024-04-24T02:06:27.887 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.885+0000 7f093619d640 1 -- 172.21.15.57:0/848810192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0930135060 msgr2=0x7f0930135470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:06:27.887 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.885+0000 7f093619d640 1 --2- 172.21.15.57:0/848810192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0930135060 0x7f0930135470 crc :-1 s=READY pgs=12892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:27.887 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.885+0000 7f093619d640 1 -- 172.21.15.57:0/848810192 shutdown_connections 2024-04-24T02:06:27.887 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.885+0000 7f093619d640 1 --2- 172.21.15.57:0/848810192 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0930135060 0x7f0930135470 unknown :-1 s=CLOSED pgs=12892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:27.887 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.885+0000 7f093619d640 1 -- 172.21.15.57:0/848810192 >> 172.21.15.57:0/848810192 conn(0x7f093006d420 msgr2=0x7f093006d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:06:27.887 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.885+0000 7f093619d640 1 -- 172.21.15.57:0/848810192 shutdown_connections 2024-04-24T02:06:27.887 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.885+0000 7f093619d640 1 -- 172.21.15.57:0/848810192 wait complete. 2024-04-24T02:06:27.887 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.886+0000 7f093619d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:06:27.890 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.888+0000 7f093619d640 1 Processor -- start 2024-04-24T02:06:27.890 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.889+0000 7f093619d640 1 -- start start 2024-04-24T02:06:27.892 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.891+0000 7f093619d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09300a25b0 0x7f093009e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:06:27.893 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.891+0000 7f093619d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f093009fb90 con 0x7f09300a25b0 2024-04-24T02:06:27.893 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.891+0000 7f092f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09300a25b0 0x7f093009e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:06:27.893 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.891+0000 7f092f7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09300a25b0 0x7f093009e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54932/0 (socket says 172.21.15.57:54932) 2024-04-24T02:06:27.893 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.891+0000 7f092f7fe640 1 -- 172.21.15.57:0/2356599968 learned_addr learned my addr 172.21.15.57:0/2356599968 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:06:27.894 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.892+0000 7f092f7fe640 1 -- 172.21.15.57:0/2356599968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f093011d260 con 0x7f09300a25b0 2024-04-24T02:06:27.894 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.892+0000 7f092f7fe640 1 --2- 172.21.15.57:0/2356599968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09300a25b0 0x7f093009e6f0 crc :-1 s=READY pgs=12893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:06:27.894 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.892+0000 7f0917fff640 1 -- 172.21.15.57:0/2356599968 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f092000e040 con 0x7f09300a25b0 2024-04-24T02:06:27.894 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.892+0000 7f0917fff640 1 -- 172.21.15.57:0/2356599968 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f09200117b0 con 0x7f09300a25b0 2024-04-24T02:06:27.894 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.892+0000 7f093619d640 1 -- 172.21.15.57:0/2356599968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f093009f880 con 0x7f09300a25b0 2024-04-24T02:06:27.894 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.892+0000 7f0917fff640 1 -- 172.21.15.57:0/2356599968 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0920011a50 con 0x7f09300a25b0 2024-04-24T02:06:27.894 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.892+0000 7f093619d640 1 -- 172.21.15.57:0/2356599968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f093011e1f0 con 0x7f09300a25b0 2024-04-24T02:06:27.896 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.893+0000 7f0917fff640 1 -- 172.21.15.57:0/2356599968 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f0920011bb0 con 0x7f09300a25b0 2024-04-24T02:06:27.896 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.894+0000 7f0917fff640 1 --2- 172.21.15.57:0/2356599968 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f091c038980 0x7f091c03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:06:27.896 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.894+0000 7f093619d640 1 -- 172.21.15.57:0/2356599968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0930069870 con 0x7f09300a25b0 2024-04-24T02:06:27.896 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.894+0000 7f0917fff640 1 -- 172.21.15.57:0/2356599968 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(698..698 src has 395..698) ==== 3791+0+0 (crc 0 0 0) 0x7f0920049c20 con 0x7f09300a25b0 2024-04-24T02:06:27.897 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.894+0000 7f0917fff640 1 -- 172.21.15.57:0/2356599968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=699}) -- 0x7f091c03eb90 con 0x7f09300a25b0 2024-04-24T02:06:27.897 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.894+0000 7f092effd640 1 --2- 172.21.15.57:0/2356599968 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f091c038980 0x7f091c03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:06:27.897 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.895+0000 7f092effd640 1 --2- 172.21.15.57:0/2356599968 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f091c038980 0x7f091c03ae90 crc :-1 s=READY pgs=3938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:06:27.902 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:27.901+0000 7f0917fff640 1 -- 172.21.15.57:0/2356599968 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f092000e570 con 0x7f09300a25b0 2024-04-24T02:06:28.101 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:28.099+0000 7f093619d640 1 -- 172.21.15.57:0/2356599968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "field": "max_objects", "val": "0"} v 0) -- 0x7f09300a1070 con 0x7f09300a25b0 2024-04-24T02:06:28.724 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:28.723+0000 7f0917fff640 1 -- 172.21.15.57:0/2356599968 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 319496fe-d53f-40fe-a120-83451e8717ac v699) ==== 221+0+0 (crc 0 0 0) 0x7f0920012980 con 0x7f09300a25b0 2024-04-24T02:06:28.726 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:28.725+0000 7f0917fff640 1 -- 172.21.15.57:0/2356599968 <== mon.0 v2:172.21.15.57:3300/0 8 ==== osd_map(699..699 src has 395..699) ==== 628+0+0 (crc 0 0 0) 0x7f0920011e60 con 0x7f09300a25b0 2024-04-24T02:06:28.726 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:28.725+0000 7fbaa3fff640 1 -- 172.21.15.57:0/650016758 <== mon.0 v2:172.21.15.57:3300/0 8 ==== osd_map(699..699 src has 395..699) ==== 628+0+0 (crc 0 0 0) 0x7fbaac06b320 con 0x23ac050 2024-04-24T02:06:28.726 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:28.725+0000 7f0917fff640 1 -- 172.21.15.57:0/2356599968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=700}) -- 0x7f091c03fb80 con 0x7f09300a25b0 2024-04-24T02:06:28.726 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:28.725+0000 7fbaa3fff640 1 -- 172.21.15.57:0/650016758 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=700}) -- 0x7fbaa803dc80 con 0x23ac050 2024-04-24T02:06:28.726 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:28.725+0000 7fbaa3fff640 1 -- 172.21.15.57:0/650016758 --> v2:172.21.15.57:6805/2600611357 -- osd_op(unknown.0.0:1 200.6 200:6b5d76a5:::two:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e699) -- 0x7fbaa803df00 con 0x23ace20 2024-04-24T02:06:28.839 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:28.838+0000 7f093619d640 1 -- 172.21.15.57:0/2356599968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "field": "max_objects", "val": "0"} v 0) -- 0x7f093011e6a0 con 0x7f09300a25b0 2024-04-24T02:06:28.937 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:28.934+0000 7fbabb7fe640 1 -- 172.21.15.57:0/650016758 <== osd.1 v2:172.21.15.57:6805/2600611357 1 ==== osd_op_reply(1 two [writefull 0~11876] v699'2 uv2 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7fbab400a430 con 0x23ace20 2024-04-24T02:06:28.937 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:28.934+0000 7fbac78ceec0 1 -- 172.21.15.57:0/650016758 >> v2:172.21.15.57:6805/2600611357 conn(0x23ace20 msgr2=0x23931d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:06:28.937 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:28.934+0000 7fbac78ceec0 1 --2- 172.21.15.57:0/650016758 >> v2:172.21.15.57:6805/2600611357 conn(0x23ace20 0x23931d0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:28.937 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:28.935+0000 7fbac78ceec0 1 -- 172.21.15.57:0/650016758 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fbaa80371c0 msgr2=0x7fbaa80396d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:06:28.937 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:28.935+0000 7fbac78ceec0 1 --2- 172.21.15.57:0/650016758 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fbaa80371c0 0x7fbaa80396d0 crc :-1 s=READY pgs=3936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:28.937 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:28.935+0000 7fbac78ceec0 1 -- 172.21.15.57:0/650016758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x23ac050 msgr2=0x243dd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:06:28.937 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:28.935+0000 7fbac78ceec0 1 --2- 172.21.15.57:0/650016758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x23ac050 0x243dd70 crc :-1 s=READY pgs=12887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:28.937 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:28.935+0000 7fbac78ceec0 1 -- 172.21.15.57:0/650016758 shutdown_connections 2024-04-24T02:06:28.937 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:28.935+0000 7fbac78ceec0 1 --2- 172.21.15.57:0/650016758 >> v2:172.21.15.57:6805/2600611357 conn(0x23ace20 0x23931d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:28.937 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:28.935+0000 7fbac78ceec0 1 --2- 172.21.15.57:0/650016758 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fbaa80371c0 0x7fbaa80396d0 unknown :-1 s=CLOSED pgs=3936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:28.937 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:28.935+0000 7fbac78ceec0 1 --2- 172.21.15.57:0/650016758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x23ac050 0x243dd70 unknown :-1 s=CLOSED pgs=12887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:28.938 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:28.935+0000 7fbac78ceec0 1 -- 172.21.15.57:0/650016758 >> 172.21.15.57:0/650016758 conn(0x22c9960 msgr2=0x24c54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:06:28.938 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:28.935+0000 7fbac78ceec0 1 -- 172.21.15.57:0/650016758 shutdown_connections 2024-04-24T02:06:28.938 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:28.935+0000 7fbac78ceec0 1 -- 172.21.15.57:0/650016758 wait complete. 2024-04-24T02:06:29.754 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.752+0000 7f0917fff640 1 -- 172.21.15.57:0/2356599968 <== mon.0 v2:172.21.15.57:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 319496fe-d53f-40fe-a120-83451e8717ac v700) ==== 221+0+0 (crc 0 0 0) 0x7f0920012b70 con 0x7f09300a25b0 2024-04-24T02:06:29.754 INFO:tasks.workunit.client.0.smithi057.stderr:set-quota max_objects = 0 for pool 319496fe-d53f-40fe-a120-83451e8717ac 2024-04-24T02:06:29.754 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.753+0000 7f0917fff640 1 -- 172.21.15.57:0/2356599968 <== mon.0 v2:172.21.15.57:3300/0 10 ==== osd_map(700..700 src has 395..700) ==== 628+0+0 (crc 0 0 0) 0x7f0920008040 con 0x7f09300a25b0 2024-04-24T02:06:29.757 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.755+0000 7f093619d640 1 -- 172.21.15.57:0/2356599968 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f091c038980 msgr2=0x7f091c03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:06:29.757 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.755+0000 7f093619d640 1 --2- 172.21.15.57:0/2356599968 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f091c038980 0x7f091c03ae90 crc :-1 s=READY pgs=3938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:29.757 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.755+0000 7f093619d640 1 -- 172.21.15.57:0/2356599968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09300a25b0 msgr2=0x7f093009e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:06:29.758 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.755+0000 7f093619d640 1 --2- 172.21.15.57:0/2356599968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09300a25b0 0x7f093009e6f0 crc :-1 s=READY pgs=12893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:29.758 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.756+0000 7f093619d640 1 -- 172.21.15.57:0/2356599968 shutdown_connections 2024-04-24T02:06:29.758 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.756+0000 7f093619d640 1 --2- 172.21.15.57:0/2356599968 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f091c038980 0x7f091c03ae90 unknown :-1 s=CLOSED pgs=3938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:29.758 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.756+0000 7f093619d640 1 --2- 172.21.15.57:0/2356599968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09300a25b0 0x7f093009e6f0 unknown :-1 s=CLOSED pgs=12893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:29.758 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.756+0000 7f093619d640 1 -- 172.21.15.57:0/2356599968 >> 172.21.15.57:0/2356599968 conn(0x7f093006d420 msgr2=0x7f09301328b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:06:29.758 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.756+0000 7f093619d640 1 -- 172.21.15.57:0/2356599968 shutdown_connections 2024-04-24T02:06:29.758 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.756+0000 7f093619d640 1 -- 172.21.15.57:0/2356599968 wait complete. 2024-04-24T02:06:29.771 INFO:tasks.workunit.client.0.smithi057.stderr:+ wait 96642 2024-04-24T02:06:29.771 INFO:tasks.workunit.client.0.smithi057.stderr:+ '[' 0 -ne 0 ']' 2024-04-24T02:06:29.771 INFO:tasks.workunit.client.0.smithi057.stderr:+ true 2024-04-24T02:06:29.771 INFO:tasks.workunit.client.0.smithi057.stderr:+ rados -p 319496fe-d53f-40fe-a120-83451e8717ac put three /etc/passwd 2024-04-24T02:06:29.817 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.815+0000 7fcecc62eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:06:29.823 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.822+0000 7fcecc62eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:06:29.824 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.822+0000 7fcecc62eec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:06:29.824 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.823+0000 7fcecc62eec0 1 Processor -- start 2024-04-24T02:06:29.825 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.823+0000 7fcecc62eec0 1 -- start start 2024-04-24T02:06:29.826 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.825+0000 7fcecc62eec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a99390 0x1b2d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:06:29.827 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.825+0000 7fcecc62eec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x19fe950 con 0x1a99390 2024-04-24T02:06:29.827 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.825+0000 7fcebf7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a99390 0x1b2d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:06:29.827 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.825+0000 7fcebf7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a99390 0x1b2d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38978/0 (socket says 172.21.15.57:38978) 2024-04-24T02:06:29.827 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.825+0000 7fcebf7fe640 1 -- 172.21.15.57:0/3638795847 learned_addr learned my addr 172.21.15.57:0/3638795847 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:06:29.827 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.825+0000 7fcebf7fe640 1 -- 172.21.15.57:0/3638795847 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x199d1e0 con 0x1a99390 2024-04-24T02:06:29.827 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.826+0000 7fcebf7fe640 1 --2- 172.21.15.57:0/3638795847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a99390 0x1b2d1d0 crc :-1 s=READY pgs=12896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0d45a32a78da2da server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:06:29.828 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.826+0000 7fcebdffb640 1 -- 172.21.15.57:0/3638795847 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fceb000b500 con 0x1a99390 2024-04-24T02:06:29.828 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.826+0000 7fcebdffb640 1 -- 172.21.15.57:0/3638795847 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fceb000b660 con 0x1a99390 2024-04-24T02:06:29.828 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.826+0000 7fcebdffb640 1 -- 172.21.15.57:0/3638795847 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fceb000b900 con 0x1a99390 2024-04-24T02:06:29.828 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.827+0000 7fcecc62eec0 1 -- 172.21.15.57:0/3638795847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a99390 msgr2=0x1b2d1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:06:29.828 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.827+0000 7fcecc62eec0 1 --2- 172.21.15.57:0/3638795847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a99390 0x1b2d1d0 crc :-1 s=READY pgs=12896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:29.829 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.827+0000 7fcecc62eec0 1 -- 172.21.15.57:0/3638795847 shutdown_connections 2024-04-24T02:06:29.829 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.827+0000 7fcecc62eec0 1 --2- 172.21.15.57:0/3638795847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a99390 0x1b2d1d0 unknown :-1 s=CLOSED pgs=12896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:29.829 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.827+0000 7fcecc62eec0 1 -- 172.21.15.57:0/3638795847 >> 172.21.15.57:0/3638795847 conn(0x19b5960 msgr2=0x1b27d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:06:29.829 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.827+0000 7fcecc62eec0 1 -- 172.21.15.57:0/3638795847 shutdown_connections 2024-04-24T02:06:29.829 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.827+0000 7fcecc62eec0 1 -- 172.21.15.57:0/3638795847 wait complete. 2024-04-24T02:06:29.829 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.828+0000 7fcecc62eec0 1 Processor -- start 2024-04-24T02:06:29.829 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.828+0000 7fcecc62eec0 1 -- start start 2024-04-24T02:06:29.831 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.830+0000 7fcecc62eec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a99390 0x1b138c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:06:29.831 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.830+0000 7fcecc62eec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x19fc3d0 con 0x1a99390 2024-04-24T02:06:29.831 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.830+0000 7fcebf7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a99390 0x1b138c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:06:29.831 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.830+0000 7fcebf7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a99390 0x1b138c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38984/0 (socket says 172.21.15.57:38984) 2024-04-24T02:06:29.831 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.830+0000 7fcebf7fe640 1 -- 172.21.15.57:0/755833817 learned_addr learned my addr 172.21.15.57:0/755833817 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:06:29.832 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.831+0000 7fcebf7fe640 1 -- 172.21.15.57:0/755833817 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x198fe30 con 0x1a99390 2024-04-24T02:06:29.832 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.831+0000 7fcebf7fe640 1 --2- 172.21.15.57:0/755833817 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a99390 0x1b138c0 crc :-1 s=READY pgs=12897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:06:29.833 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.831+0000 7fcebcff9640 1 -- 172.21.15.57:0/755833817 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fceb00111e0 con 0x1a99390 2024-04-24T02:06:29.833 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.831+0000 7fcebcff9640 1 -- 172.21.15.57:0/755833817 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fceb00119d0 con 0x1a99390 2024-04-24T02:06:29.833 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.831+0000 7fcebcff9640 1 -- 172.21.15.57:0/755833817 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fceb0011b40 con 0x1a99390 2024-04-24T02:06:29.833 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.831+0000 7fcecc62eec0 1 -- 172.21.15.57:0/755833817 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x198f890 con 0x1a99390 2024-04-24T02:06:29.833 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.831+0000 7fcecc62eec0 1 -- 172.21.15.57:0/755833817 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1a92800 con 0x1a99390 2024-04-24T02:06:29.834 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.832+0000 7fcebcff9640 1 -- 172.21.15.57:0/755833817 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fceb0011d40 con 0x1a99390 2024-04-24T02:06:29.834 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.833+0000 7fcebcff9640 1 --2- 172.21.15.57:0/755833817 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fceac0371c0 0x7fceac0396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:06:29.834 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.833+0000 7fcebcff9640 1 -- 172.21.15.57:0/755833817 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(700..700 src has 395..700) ==== 3791+0+0 (crc 0 0 0) 0x7fceb0048be0 con 0x1a99390 2024-04-24T02:06:29.835 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.833+0000 7fcebeffd640 1 --2- 172.21.15.57:0/755833817 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fceac0371c0 0x7fceac0396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:06:29.835 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.833+0000 7fcecc62eec0 1 --2- 172.21.15.57:0/755833817 >> v2:172.21.15.84:6808/91137974 conn(0x1b2e7b0 0x1bc09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:06:29.835 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.833+0000 7fcecc62eec0 1 -- 172.21.15.57:0/755833817 --> v2:172.21.15.84:6808/91137974 -- osd_op(unknown.0.0:1 200.3 200:c57798d7:::three:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e700) -- 0x1b16480 con 0x1b2e7b0 2024-04-24T02:06:29.835 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.834+0000 7fcebeffd640 1 --2- 172.21.15.57:0/755833817 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fceac0371c0 0x7fceac0396d0 crc :-1 s=READY pgs=3939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:06:29.836 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.834+0000 7fcebffff640 1 --2- 172.21.15.57:0/755833817 >> v2:172.21.15.84:6808/91137974 conn(0x1b2e7b0 0x1bc09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T02:06:29.839 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:29.838+0000 7fcebffff640 1 --2- 172.21.15.57:0/755833817 >> v2:172.21.15.84:6808/91137974 conn(0x1b2e7b0 0x1bc09a0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:06:30.128 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.126+0000 7fcebffff640 1 -- 172.21.15.57:0/755833817 <== osd.3 v2:172.21.15.84:6808/91137974 1 ==== osd_op_reply(1 three [writefull 0~11876] v700'2 uv2 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fceb800a430 con 0x1b2e7b0 2024-04-24T02:06:30.128 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.126+0000 7fcecc62eec0 1 -- 172.21.15.57:0/755833817 >> v2:172.21.15.84:6808/91137974 conn(0x1b2e7b0 msgr2=0x1bc09a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:06:30.128 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.126+0000 7fcecc62eec0 1 --2- 172.21.15.57:0/755833817 >> v2:172.21.15.84:6808/91137974 conn(0x1b2e7b0 0x1bc09a0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:30.129 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.126+0000 7fcecc62eec0 1 -- 172.21.15.57:0/755833817 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fceac0371c0 msgr2=0x7fceac0396d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:06:30.129 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.126+0000 7fcecc62eec0 1 --2- 172.21.15.57:0/755833817 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fceac0371c0 0x7fceac0396d0 crc :-1 s=READY pgs=3939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:30.129 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.126+0000 7fcecc62eec0 1 -- 172.21.15.57:0/755833817 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a99390 msgr2=0x1b138c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:06:30.129 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.126+0000 7fcecc62eec0 1 --2- 172.21.15.57:0/755833817 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a99390 0x1b138c0 crc :-1 s=READY pgs=12897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:30.129 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.126+0000 7fcecc62eec0 1 -- 172.21.15.57:0/755833817 shutdown_connections 2024-04-24T02:06:30.129 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.126+0000 7fcecc62eec0 1 --2- 172.21.15.57:0/755833817 >> v2:172.21.15.84:6808/91137974 conn(0x1b2e7b0 0x1bc09a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:30.129 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.126+0000 7fcecc62eec0 1 --2- 172.21.15.57:0/755833817 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fceac0371c0 0x7fceac0396d0 unknown :-1 s=CLOSED pgs=3939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:30.129 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.126+0000 7fcecc62eec0 1 --2- 172.21.15.57:0/755833817 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1a99390 0x1b138c0 unknown :-1 s=CLOSED pgs=12897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:30.129 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.126+0000 7fcecc62eec0 1 -- 172.21.15.57:0/755833817 >> 172.21.15.57:0/755833817 conn(0x19b5960 msgr2=0x1b2a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:06:30.129 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.127+0000 7fcecc62eec0 1 -- 172.21.15.57:0/755833817 shutdown_connections 2024-04-24T02:06:30.129 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.127+0000 7fcecc62eec0 1 -- 172.21.15.57:0/755833817 wait complete. 2024-04-24T02:06:30.130 INFO:tasks.workunit.client.0.smithi057.stderr:++ uuidgen 2024-04-24T02:06:30.131 INFO:tasks.workunit.client.0.smithi057.stderr:+ pp=09b3c512-40ed-4aad-9a96-edbc8decb8dc 2024-04-24T02:06:30.131 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph osd pool create 09b3c512-40ed-4aad-9a96-edbc8decb8dc 12 2024-04-24T02:06:30.227 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.218+0000 7ffb6c06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:06:30.228 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.227+0000 7ffb6c06d640 1 Processor -- start 2024-04-24T02:06:30.228 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.227+0000 7ffb6c06d640 1 -- start start 2024-04-24T02:06:30.230 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.228+0000 7ffb6c06d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ffb64137e70 0x7ffb6413a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:06:30.231 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.228+0000 7ffb6c06d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb6409adf0 con 0x7ffb640a2a80 2024-04-24T02:06:30.231 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.228+0000 7ffb6c06d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7ffb6409b3e0 con 0x7ffb64137e70 2024-04-24T02:06:30.231 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.229+0000 7ffb69608640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ffb64137e70 0x7ffb6413a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:06:30.231 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.229+0000 7ffb69e09640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ffb640a2a80 0x7ffb640a2e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58064/0 (socket says 172.21.15.57:58064) 2024-04-24T02:06:30.231 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.229+0000 7ffb69e09640 1 -- 172.21.15.57:0/843191270 learned_addr learned my addr 172.21.15.57:0/843191270 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T02:06:30.231 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.229+0000 7ffb69608640 1 -- 172.21.15.57:0/843191270 >> v1:172.21.15.57:6789/0 conn(0x7ffb640a2a80 legacy=0x7ffb640a2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:06:30.231 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.229+0000 7ffb69608640 1 -- 172.21.15.57:0/843191270 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb640a2650 con 0x7ffb64137e70 2024-04-24T02:06:30.231 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.229+0000 7ffb69608640 1 --2- 172.21.15.57:0/843191270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb64137e70 0x7ffb6413a290 crc :-1 s=READY pgs=12899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19711c0b3c0c5993 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:06:30.231 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.229+0000 7ffb68e07640 1 -- 172.21.15.57:0/843191270 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffb58009d90 con 0x7ffb64137e70 2024-04-24T02:06:30.231 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.229+0000 7ffb68e07640 1 -- 172.21.15.57:0/843191270 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ffb5800e230 con 0x7ffb64137e70 2024-04-24T02:06:30.231 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.229+0000 7ffb68e07640 1 -- 172.21.15.57:0/843191270 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffb5800e4d0 con 0x7ffb64137e70 2024-04-24T02:06:30.232 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.230+0000 7ffb6c06d640 1 -- 172.21.15.57:0/843191270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb64137e70 msgr2=0x7ffb6413a290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:06:30.232 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.230+0000 7ffb6c06d640 1 --2- 172.21.15.57:0/843191270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb64137e70 0x7ffb6413a290 crc :-1 s=READY pgs=12899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:30.233 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.230+0000 7ffb6c06d640 1 -- 172.21.15.57:0/843191270 shutdown_connections 2024-04-24T02:06:30.233 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.230+0000 7ffb6c06d640 1 --2- 172.21.15.57:0/843191270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb64137e70 0x7ffb6413a290 unknown :-1 s=CLOSED pgs=12899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:30.233 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.230+0000 7ffb6c06d640 1 -- 172.21.15.57:0/843191270 >> 172.21.15.57:0/843191270 conn(0x7ffb6406d420 msgr2=0x7ffb6406d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:06:30.233 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.230+0000 7ffb6c06d640 1 -- 172.21.15.57:0/843191270 shutdown_connections 2024-04-24T02:06:30.233 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.230+0000 7ffb6c06d640 1 -- 172.21.15.57:0/843191270 wait complete. 2024-04-24T02:06:30.233 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.230+0000 7ffb6c06d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:06:30.233 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.232+0000 7ffb6c06d640 1 Processor -- start 2024-04-24T02:06:30.233 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.232+0000 7ffb6c06d640 1 -- start start 2024-04-24T02:06:30.235 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.233+0000 7ffb6c06d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb640a2a80 0x7ffb6411f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:06:30.236 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.233+0000 7ffb6c06d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6411f200 con 0x7ffb640a2a80 2024-04-24T02:06:30.236 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.234+0000 7ffb69e09640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb640a2a80 0x7ffb6411f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:06:30.236 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.234+0000 7ffb69e09640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb640a2a80 0x7ffb6411f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39008/0 (socket says 172.21.15.57:39008) 2024-04-24T02:06:30.236 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.234+0000 7ffb69e09640 1 -- 172.21.15.57:0/3044101163 learned_addr learned my addr 172.21.15.57:0/3044101163 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:06:30.236 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.234+0000 7ffb69e09640 1 -- 172.21.15.57:0/3044101163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb641206e0 con 0x7ffb640a2a80 2024-04-24T02:06:30.236 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.234+0000 7ffb69e09640 1 --2- 172.21.15.57:0/3044101163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb640a2a80 0x7ffb6411f580 crc :-1 s=READY pgs=12900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:06:30.236 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.234+0000 7ffb627fc640 1 -- 172.21.15.57:0/3044101163 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffb5c005a60 con 0x7ffb640a2a80 2024-04-24T02:06:30.236 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.234+0000 7ffb627fc640 1 -- 172.21.15.57:0/3044101163 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ffb5c005bc0 con 0x7ffb640a2a80 2024-04-24T02:06:30.236 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.234+0000 7ffb6c06d640 1 -- 172.21.15.57:0/3044101163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb64122bd0 con 0x7ffb640a2a80 2024-04-24T02:06:30.236 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.234+0000 7ffb627fc640 1 -- 172.21.15.57:0/3044101163 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ffb5c005e60 con 0x7ffb640a2a80 2024-04-24T02:06:30.236 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.234+0000 7ffb6c06d640 1 -- 172.21.15.57:0/3044101163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb64122750 con 0x7ffb640a2a80 2024-04-24T02:06:30.237 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.235+0000 7ffb627fc640 1 -- 172.21.15.57:0/3044101163 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7ffb5c0070b0 con 0x7ffb640a2a80 2024-04-24T02:06:30.237 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.235+0000 7ffb627fc640 1 --2- 172.21.15.57:0/3044101163 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7ffb50038930 0x7ffb5003ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:06:30.237 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.235+0000 7ffb6c06d640 1 -- 172.21.15.57:0/3044101163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb64069870 con 0x7ffb640a2a80 2024-04-24T02:06:30.237 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.235+0000 7ffb627fc640 1 -- 172.21.15.57:0/3044101163 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(700..700 src has 395..700) ==== 3791+0+0 (crc 0 0 0) 0x7ffb5c048560 con 0x7ffb640a2a80 2024-04-24T02:06:30.237 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.236+0000 7ffb69608640 1 --2- 172.21.15.57:0/3044101163 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7ffb50038930 0x7ffb5003ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:06:30.238 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.236+0000 7ffb69608640 1 --2- 172.21.15.57:0/3044101163 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7ffb50038930 0x7ffb5003ae40 crc :-1 s=READY pgs=3940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:06:30.242 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.241+0000 7ffb627fc640 1 -- 172.21.15.57:0/3044101163 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7ffb5c00d510 con 0x7ffb640a2a80 2024-04-24T02:06:30.507 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.505+0000 7ffb6c06d640 1 -- 172.21.15.57:0/3044101163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "09b3c512-40ed-4aad-9a96-edbc8decb8dc", "pg_num": 12} v 0) -- 0x7ffb64068290 con 0x7ffb640a2a80 2024-04-24T02:06:30.768 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.767+0000 7ffb627fc640 1 -- 172.21.15.57:0/3044101163 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "09b3c512-40ed-4aad-9a96-edbc8decb8dc", "pg_num": 12}]=0 pool '09b3c512-40ed-4aad-9a96-edbc8decb8dc' created v701) ==== 176+0+0 (crc 0 0 0) 0x7ffb5c00d150 con 0x7ffb640a2a80 2024-04-24T02:06:30.925 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.924+0000 7ffb6c06d640 1 -- 172.21.15.57:0/3044101163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "09b3c512-40ed-4aad-9a96-edbc8decb8dc", "pg_num": 12} v 0) -- 0x7ffb64121d80 con 0x7ffb640a2a80 2024-04-24T02:06:30.926 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.925+0000 7ffb627fc640 1 -- 172.21.15.57:0/3044101163 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "09b3c512-40ed-4aad-9a96-edbc8decb8dc", "pg_num": 12}]=0 pool '09b3c512-40ed-4aad-9a96-edbc8decb8dc' already exists v701) ==== 183+0+0 (crc 0 0 0) 0x7ffb5c00d330 con 0x7ffb640a2a80 2024-04-24T02:06:30.926 INFO:tasks.workunit.client.0.smithi057.stderr:pool '09b3c512-40ed-4aad-9a96-edbc8decb8dc' already exists 2024-04-24T02:06:30.930 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.928+0000 7ffb6c06d640 1 -- 172.21.15.57:0/3044101163 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7ffb50038930 msgr2=0x7ffb5003ae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:06:30.930 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.928+0000 7ffb6c06d640 1 --2- 172.21.15.57:0/3044101163 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7ffb50038930 0x7ffb5003ae40 crc :-1 s=READY pgs=3940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:30.930 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.928+0000 7ffb6c06d640 1 -- 172.21.15.57:0/3044101163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb640a2a80 msgr2=0x7ffb6411f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:06:30.930 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.928+0000 7ffb6c06d640 1 --2- 172.21.15.57:0/3044101163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb640a2a80 0x7ffb6411f580 crc :-1 s=READY pgs=12900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:30.930 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.929+0000 7ffb6c06d640 1 -- 172.21.15.57:0/3044101163 shutdown_connections 2024-04-24T02:06:30.931 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.929+0000 7ffb6c06d640 1 --2- 172.21.15.57:0/3044101163 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7ffb50038930 0x7ffb5003ae40 unknown :-1 s=CLOSED pgs=3940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:30.931 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.929+0000 7ffb6c06d640 1 --2- 172.21.15.57:0/3044101163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffb640a2a80 0x7ffb6411f580 unknown :-1 s=CLOSED pgs=12900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:30.931 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.929+0000 7ffb6c06d640 1 -- 172.21.15.57:0/3044101163 >> 172.21.15.57:0/3044101163 conn(0x7ffb6406d420 msgr2=0x7ffb64134930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:06:30.931 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.929+0000 7ffb6c06d640 1 -- 172.21.15.57:0/3044101163 shutdown_connections 2024-04-24T02:06:30.931 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:30.929+0000 7ffb6c06d640 1 -- 172.21.15.57:0/3044101163 wait complete. 2024-04-24T02:06:30.948 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph osd pool application enable 09b3c512-40ed-4aad-9a96-edbc8decb8dc rados 2024-04-24T02:06:31.058 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.045+0000 7ff97f26d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:06:31.059 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.058+0000 7ff97f26d640 1 Processor -- start 2024-04-24T02:06:31.060 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.059+0000 7ff97f26d640 1 -- start start 2024-04-24T02:06:31.062 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.061+0000 7ff97f26d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff9780a2dc0 0x7ff97813a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:06:31.062 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.061+0000 7ff97f26d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff97809f110 con 0x7ff97806dff0 2024-04-24T02:06:31.062 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.061+0000 7ff97f26d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7ff97809dfd0 con 0x7ff9780a2dc0 2024-04-24T02:06:31.062 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.061+0000 7ff97c808640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff9780a2dc0 0x7ff97813a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:06:31.062 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.061+0000 7ff97d009640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff97806dff0 0x7ff9780a26b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58066/0 (socket says 172.21.15.57:58066) 2024-04-24T02:06:31.062 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.061+0000 7ff97d009640 1 -- 172.21.15.57:0/3830748882 learned_addr learned my addr 172.21.15.57:0/3830748882 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T02:06:31.063 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.061+0000 7ff97c808640 1 -- 172.21.15.57:0/3830748882 >> v1:172.21.15.57:6789/0 conn(0x7ff97806dff0 legacy=0x7ff9780a26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:06:31.063 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.061+0000 7ff97c808640 1 -- 172.21.15.57:0/3830748882 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9780a0280 con 0x7ff9780a2dc0 2024-04-24T02:06:31.063 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.062+0000 7ff97c808640 1 --2- 172.21.15.57:0/3830748882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9780a2dc0 0x7ff97813a4a0 crc :-1 s=READY pgs=12902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4f5005cae057f49 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:06:31.063 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.062+0000 7ff96ffff640 1 -- 172.21.15.57:0/3830748882 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff968009d90 con 0x7ff9780a2dc0 2024-04-24T02:06:31.064 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.062+0000 7ff96ffff640 1 -- 172.21.15.57:0/3830748882 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff96800e230 con 0x7ff9780a2dc0 2024-04-24T02:06:31.064 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.062+0000 7ff96ffff640 1 -- 172.21.15.57:0/3830748882 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff96800e4d0 con 0x7ff9780a2dc0 2024-04-24T02:06:31.065 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.063+0000 7ff97f26d640 1 -- 172.21.15.57:0/3830748882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9780a2dc0 msgr2=0x7ff97813a4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:06:31.065 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.063+0000 7ff97f26d640 1 --2- 172.21.15.57:0/3830748882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9780a2dc0 0x7ff97813a4a0 crc :-1 s=READY pgs=12902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:31.065 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.063+0000 7ff97f26d640 1 -- 172.21.15.57:0/3830748882 shutdown_connections 2024-04-24T02:06:31.065 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.063+0000 7ff97f26d640 1 --2- 172.21.15.57:0/3830748882 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9780a2dc0 0x7ff97813a4a0 unknown :-1 s=CLOSED pgs=12902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:31.065 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.063+0000 7ff97f26d640 1 -- 172.21.15.57:0/3830748882 >> 172.21.15.57:0/3830748882 conn(0x7ff97806d4d0 msgr2=0x7ff97806d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:06:31.065 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.063+0000 7ff97f26d640 1 -- 172.21.15.57:0/3830748882 shutdown_connections 2024-04-24T02:06:31.065 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.063+0000 7ff97f26d640 1 -- 172.21.15.57:0/3830748882 wait complete. 2024-04-24T02:06:31.065 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.063+0000 7ff97f26d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:06:31.066 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.065+0000 7ff97f26d640 1 Processor -- start 2024-04-24T02:06:31.067 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.065+0000 7ff97f26d640 1 -- start start 2024-04-24T02:06:31.069 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.067+0000 7ff97f26d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff97806dff0 0x7ff9781c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:06:31.069 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.067+0000 7ff97f26d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff9781ab3e0 con 0x7ff97806dff0 2024-04-24T02:06:31.069 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.067+0000 7ff97d009640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff97806dff0 0x7ff9781c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:06:31.069 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.067+0000 7ff97d009640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff97806dff0 0x7ff9781c9b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39030/0 (socket says 172.21.15.57:39030) 2024-04-24T02:06:31.069 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.067+0000 7ff97d009640 1 -- 172.21.15.57:0/401645476 learned_addr learned my addr 172.21.15.57:0/401645476 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:06:31.069 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.068+0000 7ff97d009640 1 -- 172.21.15.57:0/401645476 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9781acab0 con 0x7ff97806dff0 2024-04-24T02:06:31.070 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.068+0000 7ff97d009640 1 --2- 172.21.15.57:0/401645476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff97806dff0 0x7ff9781c9b40 crc :-1 s=READY pgs=12903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:06:31.070 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.068+0000 7ff96dffb640 1 -- 172.21.15.57:0/401645476 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff974005a60 con 0x7ff97806dff0 2024-04-24T02:06:31.070 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.068+0000 7ff96dffb640 1 -- 172.21.15.57:0/401645476 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff974005bc0 con 0x7ff97806dff0 2024-04-24T02:06:31.070 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.068+0000 7ff97f26d640 1 -- 172.21.15.57:0/401645476 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9781acd50 con 0x7ff97806dff0 2024-04-24T02:06:31.071 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.068+0000 7ff96dffb640 1 -- 172.21.15.57:0/401645476 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff974005e60 con 0x7ff97806dff0 2024-04-24T02:06:31.071 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.069+0000 7ff97f26d640 1 -- 172.21.15.57:0/401645476 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9781ac3d0 con 0x7ff97806dff0 2024-04-24T02:06:31.071 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.070+0000 7ff96dffb640 1 -- 172.21.15.57:0/401645476 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7ff97400c780 con 0x7ff97806dff0 2024-04-24T02:06:31.072 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.070+0000 7ff96dffb640 1 --2- 172.21.15.57:0/401645476 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7ff95c038960 0x7ff95c03ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:06:31.072 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.070+0000 7ff97f26d640 1 -- 172.21.15.57:0/401645476 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9781ad740 con 0x7ff97806dff0 2024-04-24T02:06:31.072 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.070+0000 7ff96dffb640 1 -- 172.21.15.57:0/401645476 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(701..701 src has 395..701) ==== 4166+0+0 (crc 0 0 0) 0x7ff974048780 con 0x7ff97806dff0 2024-04-24T02:06:31.072 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.070+0000 7ff97c808640 1 --2- 172.21.15.57:0/401645476 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7ff95c038960 0x7ff95c03ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:06:31.072 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.071+0000 7ff97c808640 1 --2- 172.21.15.57:0/401645476 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7ff95c038960 0x7ff95c03ae70 crc :-1 s=READY pgs=3941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:06:31.077 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.076+0000 7ff96dffb640 1 -- 172.21.15.57:0/401645476 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7ff97400d150 con 0x7ff97806dff0 2024-04-24T02:06:31.300 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.299+0000 7ff97f26d640 1 -- 172.21.15.57:0/401645476 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "09b3c512-40ed-4aad-9a96-edbc8decb8dc", "app": "rados"} v 0) -- 0x7ff97809f870 con 0x7ff97806dff0 2024-04-24T02:06:31.774 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.773+0000 7ff96dffb640 1 -- 172.21.15.57:0/401645476 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "09b3c512-40ed-4aad-9a96-edbc8decb8dc", "app": "rados"}]=0 enabled application 'rados' on pool '09b3c512-40ed-4aad-9a96-edbc8decb8dc' v702) ==== 213+0+0 (crc 0 0 0) 0x7ff97809f870 con 0x7ff97806dff0 2024-04-24T02:06:31.994 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:31.992+0000 7ff97f26d640 1 -- 172.21.15.57:0/401645476 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "09b3c512-40ed-4aad-9a96-edbc8decb8dc", "app": "rados"} v 0) -- 0x7ff97809f870 con 0x7ff97806dff0 2024-04-24T02:06:32.785 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.784+0000 7ff96dffb640 1 -- 172.21.15.57:0/401645476 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "09b3c512-40ed-4aad-9a96-edbc8decb8dc", "app": "rados"}]=0 enabled application 'rados' on pool '09b3c512-40ed-4aad-9a96-edbc8decb8dc' v703) ==== 213+0+0 (crc 0 0 0) 0x7ff97809f870 con 0x7ff97806dff0 2024-04-24T02:06:32.785 INFO:tasks.workunit.client.0.smithi057.stderr:enabled application 'rados' on pool '09b3c512-40ed-4aad-9a96-edbc8decb8dc' 2024-04-24T02:06:32.788 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.786+0000 7ff97f26d640 1 -- 172.21.15.57:0/401645476 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7ff95c038960 msgr2=0x7ff95c03ae70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:06:32.788 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.786+0000 7ff97f26d640 1 --2- 172.21.15.57:0/401645476 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7ff95c038960 0x7ff95c03ae70 crc :-1 s=READY pgs=3941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:32.788 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.786+0000 7ff97f26d640 1 -- 172.21.15.57:0/401645476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff97806dff0 msgr2=0x7ff9781c9b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:06:32.788 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.786+0000 7ff97f26d640 1 --2- 172.21.15.57:0/401645476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff97806dff0 0x7ff9781c9b40 crc :-1 s=READY pgs=12903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:32.789 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.786+0000 7ff97f26d640 1 -- 172.21.15.57:0/401645476 shutdown_connections 2024-04-24T02:06:32.789 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.786+0000 7ff97f26d640 1 --2- 172.21.15.57:0/401645476 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7ff95c038960 0x7ff95c03ae70 unknown :-1 s=CLOSED pgs=3941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:32.789 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.786+0000 7ff97f26d640 1 --2- 172.21.15.57:0/401645476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff97806dff0 0x7ff9781c9b40 unknown :-1 s=CLOSED pgs=12903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:32.789 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.787+0000 7ff97f26d640 1 -- 172.21.15.57:0/401645476 >> 172.21.15.57:0/401645476 conn(0x7ff97806d4d0 msgr2=0x7ff97809bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:06:32.789 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.787+0000 7ff97f26d640 1 -- 172.21.15.57:0/401645476 shutdown_connections 2024-04-24T02:06:32.789 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.787+0000 7ff97f26d640 1 -- 172.21.15.57:0/401645476 wait complete. 2024-04-24T02:06:32.799 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph osd pool set-quota 09b3c512-40ed-4aad-9a96-edbc8decb8dc max_objects 10 2024-04-24T02:06:32.900 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.890+0000 7fdb3535d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:06:32.901 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.900+0000 7fdb3535d640 1 Processor -- start 2024-04-24T02:06:32.901 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.900+0000 7fdb3535d640 1 -- start start 2024-04-24T02:06:32.904 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.902+0000 7fdb3535d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdb3006fed0 0x7fdb3012e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:06:32.904 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.902+0000 7fdb3535d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb3012e290 con 0x7fdb3012ed10 2024-04-24T02:06:32.904 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.902+0000 7fdb3535d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fdb3006fc10 con 0x7fdb3006fed0 2024-04-24T02:06:32.904 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.902+0000 7fdb2effd640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdb3006fed0 0x7fdb3012e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:06:32.904 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.902+0000 7fdb2e7fc640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fdb3012ed10 0x7fdb30131790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58078/0 (socket says 172.21.15.57:58078) 2024-04-24T02:06:32.904 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.902+0000 7fdb2e7fc640 1 -- 172.21.15.57:0/2335054260 learned_addr learned my addr 172.21.15.57:0/2335054260 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T02:06:32.904 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.902+0000 7fdb2effd640 1 -- 172.21.15.57:0/2335054260 >> v1:172.21.15.57:6789/0 conn(0x7fdb3012ed10 legacy=0x7fdb30131790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:06:32.904 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.902+0000 7fdb2dffb640 1 -- 172.21.15.57:0/2335054260 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2390120482 0 0) 0x7fdb3012e290 con 0x7fdb3012ed10 2024-04-24T02:06:32.904 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.902+0000 7fdb2effd640 1 -- 172.21.15.57:0/2335054260 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb300702e0 con 0x7fdb3006fed0 2024-04-24T02:06:32.904 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.903+0000 7fdb2effd640 1 --2- 172.21.15.57:0/2335054260 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb3006fed0 0x7fdb3012e7d0 crc :-1 s=READY pgs=12905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf85def8ddf10d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:06:32.905 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.903+0000 7fdb2dffb640 1 -- 172.21.15.57:0/2335054260 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdb20009d90 con 0x7fdb3006fed0 2024-04-24T02:06:32.905 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.903+0000 7fdb2dffb640 1 -- 172.21.15.57:0/2335054260 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdb2000e230 con 0x7fdb3006fed0 2024-04-24T02:06:32.905 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.903+0000 7fdb2dffb640 1 -- 172.21.15.57:0/2335054260 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdb2000e4d0 con 0x7fdb3006fed0 2024-04-24T02:06:32.906 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.903+0000 7fdb3535d640 1 -- 172.21.15.57:0/2335054260 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb3006fed0 msgr2=0x7fdb3012e7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:06:32.906 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.903+0000 7fdb3535d640 1 --2- 172.21.15.57:0/2335054260 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb3006fed0 0x7fdb3012e7d0 crc :-1 s=READY pgs=12905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:32.906 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.904+0000 7fdb3535d640 1 -- 172.21.15.57:0/2335054260 shutdown_connections 2024-04-24T02:06:32.906 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.904+0000 7fdb3535d640 1 --2- 172.21.15.57:0/2335054260 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb3006fed0 0x7fdb3012e7d0 unknown :-1 s=CLOSED pgs=12905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:32.906 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.904+0000 7fdb3535d640 1 -- 172.21.15.57:0/2335054260 >> 172.21.15.57:0/2335054260 conn(0x7fdb300a0810 msgr2=0x7fdb300a0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:06:32.906 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.904+0000 7fdb3535d640 1 -- 172.21.15.57:0/2335054260 shutdown_connections 2024-04-24T02:06:32.906 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.904+0000 7fdb3535d640 1 -- 172.21.15.57:0/2335054260 wait complete. 2024-04-24T02:06:32.906 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.904+0000 7fdb3535d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:06:32.907 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.906+0000 7fdb3535d640 1 Processor -- start 2024-04-24T02:06:32.907 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.906+0000 7fdb3535d640 1 -- start start 2024-04-24T02:06:32.908 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.907+0000 7fdb3535d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb3006fed0 0x7fdb3011cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:06:32.909 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.907+0000 7fdb3535d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fdb3006cc20 con 0x7fdb3006fed0 2024-04-24T02:06:32.909 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.907+0000 7fdb2effd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb3006fed0 0x7fdb3011cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:06:32.909 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.907+0000 7fdb2effd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb3006fed0 0x7fdb3011cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:39040/0 (socket says 172.21.15.57:39040) 2024-04-24T02:06:32.909 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.907+0000 7fdb2effd640 1 -- 172.21.15.57:0/4206865157 learned_addr learned my addr 172.21.15.57:0/4206865157 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:06:32.909 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.908+0000 7fdb2effd640 1 -- 172.21.15.57:0/4206865157 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb3011e7d0 con 0x7fdb3006fed0 2024-04-24T02:06:32.910 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.908+0000 7fdb2effd640 1 --2- 172.21.15.57:0/4206865157 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb3006fed0 0x7fdb3011cf00 crc :-1 s=READY pgs=12906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:06:32.910 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.908+0000 7fdb277fe640 1 -- 172.21.15.57:0/4206865157 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdb20013610 con 0x7fdb3006fed0 2024-04-24T02:06:32.910 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.908+0000 7fdb277fe640 1 -- 172.21.15.57:0/4206865157 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fdb20013770 con 0x7fdb3006fed0 2024-04-24T02:06:32.910 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.908+0000 7fdb3535d640 1 -- 172.21.15.57:0/4206865157 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb3009bd60 con 0x7fdb3006fed0 2024-04-24T02:06:32.910 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.908+0000 7fdb277fe640 1 -- 172.21.15.57:0/4206865157 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fdb20013a10 con 0x7fdb3006fed0 2024-04-24T02:06:32.910 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.908+0000 7fdb3535d640 1 -- 172.21.15.57:0/4206865157 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb3011e110 con 0x7fdb3006fed0 2024-04-24T02:06:32.911 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.909+0000 7fdb3535d640 1 -- 172.21.15.57:0/4206865157 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb3011f600 con 0x7fdb3006fed0 2024-04-24T02:06:32.911 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.909+0000 7fdb277fe640 1 -- 172.21.15.57:0/4206865157 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fdb20013bc0 con 0x7fdb3006fed0 2024-04-24T02:06:32.911 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.909+0000 7fdb277fe640 1 --2- 172.21.15.57:0/4206865157 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fdb10038980 0x7fdb1003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:06:32.911 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.910+0000 7fdb277fe640 1 -- 172.21.15.57:0/4206865157 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(703..703 src has 395..703) ==== 4179+0+0 (crc 0 0 0) 0x7fdb20018040 con 0x7fdb3006fed0 2024-04-24T02:06:32.911 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.910+0000 7fdb2e7fc640 1 --2- 172.21.15.57:0/4206865157 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fdb10038980 0x7fdb1003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:06:32.911 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.910+0000 7fdb2e7fc640 1 --2- 172.21.15.57:0/4206865157 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fdb10038980 0x7fdb1003ae90 crc :-1 s=READY pgs=3942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:06:32.916 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:32.915+0000 7fdb277fe640 1 -- 172.21.15.57:0/4206865157 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fdb2004d040 con 0x7fdb3006fed0 2024-04-24T02:06:33.108 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:33.107+0000 7fdb3535d640 1 -- 172.21.15.57:0/4206865157 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "09b3c512-40ed-4aad-9a96-edbc8decb8dc", "field": "max_objects", "val": "10"} v 0) -- 0x7fdb30069870 con 0x7fdb3006fed0 2024-04-24T02:06:33.725 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:33.724+0000 7fdb277fe640 1 -- 172.21.15.57:0/4206865157 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "09b3c512-40ed-4aad-9a96-edbc8decb8dc", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 09b3c512-40ed-4aad-9a96-edbc8decb8dc v704) ==== 223+0+0 (crc 0 0 0) 0x7fdb20018c30 con 0x7fdb3006fed0 2024-04-24T02:06:33.878 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:33.877+0000 7fdb3535d640 1 -- 172.21.15.57:0/4206865157 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "09b3c512-40ed-4aad-9a96-edbc8decb8dc", "field": "max_objects", "val": "10"} v 0) -- 0x7fdb300008d0 con 0x7fdb3006fed0 2024-04-24T02:06:34.797 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:34.796+0000 7fdb277fe640 1 -- 172.21.15.57:0/4206865157 <== mon.0 v2:172.21.15.57:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "09b3c512-40ed-4aad-9a96-edbc8decb8dc", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 09b3c512-40ed-4aad-9a96-edbc8decb8dc v705) ==== 223+0+0 (crc 0 0 0) 0x7fdb20007e30 con 0x7fdb3006fed0 2024-04-24T02:06:34.797 INFO:tasks.workunit.client.0.smithi057.stderr:set-quota max_objects = 10 for pool 09b3c512-40ed-4aad-9a96-edbc8decb8dc 2024-04-24T02:06:34.800 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:34.799+0000 7fdb3535d640 1 -- 172.21.15.57:0/4206865157 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fdb10038980 msgr2=0x7fdb1003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:06:34.800 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:34.799+0000 7fdb3535d640 1 --2- 172.21.15.57:0/4206865157 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fdb10038980 0x7fdb1003ae90 crc :-1 s=READY pgs=3942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:34.801 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:34.799+0000 7fdb3535d640 1 -- 172.21.15.57:0/4206865157 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb3006fed0 msgr2=0x7fdb3011cf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:06:34.801 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:34.799+0000 7fdb3535d640 1 --2- 172.21.15.57:0/4206865157 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb3006fed0 0x7fdb3011cf00 crc :-1 s=READY pgs=12906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:34.801 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:34.799+0000 7fdb3535d640 1 -- 172.21.15.57:0/4206865157 shutdown_connections 2024-04-24T02:06:34.801 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:34.799+0000 7fdb3535d640 1 --2- 172.21.15.57:0/4206865157 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fdb10038980 0x7fdb1003ae90 unknown :-1 s=CLOSED pgs=3942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:34.801 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:34.799+0000 7fdb3535d640 1 --2- 172.21.15.57:0/4206865157 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb3006fed0 0x7fdb3011cf00 unknown :-1 s=CLOSED pgs=12906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:06:34.801 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:34.799+0000 7fdb3535d640 1 -- 172.21.15.57:0/4206865157 >> 172.21.15.57:0/4206865157 conn(0x7fdb300a0810 msgr2=0x7fdb301315a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:06:34.801 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:34.799+0000 7fdb3535d640 1 -- 172.21.15.57:0/4206865157 shutdown_connections 2024-04-24T02:06:34.801 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:06:34.799+0000 7fdb3535d640 1 -- 172.21.15.57:0/4206865157 wait complete. 2024-04-24T02:06:34.812 INFO:tasks.workunit.client.0.smithi057.stderr:+ sleep 30 2024-04-24T02:07:04.815 INFO:tasks.workunit.client.0.smithi057.stderr:++ seq 1 10 2024-04-24T02:07:04.815 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in `seq 1 10` 2024-04-24T02:07:04.815 INFO:tasks.workunit.client.0.smithi057.stderr:+ rados -p 09b3c512-40ed-4aad-9a96-edbc8decb8dc put obj1 /etc/passwd 2024-04-24T02:07:04.860 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.858+0000 7f7b6882cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:04.866 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.865+0000 7f7b6882cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:04.866 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.865+0000 7f7b6882cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:04.867 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.866+0000 7f7b6882cec0 1 Processor -- start 2024-04-24T02:07:04.867 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.866+0000 7f7b6882cec0 1 -- start start 2024-04-24T02:07:04.869 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.867+0000 7f7b6882cec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1dc8f40 0x1db2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:04.869 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.867+0000 7f7b6882cec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x1d30950 con 0x1dc8f40 2024-04-24T02:07:04.869 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.867+0000 7f7b6099b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1dc8f40 0x1db2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:04.869 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.867+0000 7f7b6099b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1dc8f40 0x1db2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48184/0 (socket says 172.21.15.57:48184) 2024-04-24T02:07:04.869 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.867+0000 7f7b6099b640 1 -- 172.21.15.57:0/104705469 learned_addr learned my addr 172.21.15.57:0/104705469 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:07:04.869 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.868+0000 7f7b6099b640 1 -- 172.21.15.57:0/104705469 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1ccf1e0 con 0x1dc8f40 2024-04-24T02:07:04.869 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.868+0000 7f7b6099b640 1 --2- 172.21.15.57:0/104705469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1dc8f40 0x1db2640 crc :-1 s=READY pgs=12909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c7a7759467b665d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:04.875 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.874+0000 7f7b5a7fc640 1 -- 172.21.15.57:0/104705469 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7b4c00b500 con 0x1dc8f40 2024-04-24T02:07:04.875 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.874+0000 7f7b5a7fc640 1 -- 172.21.15.57:0/104705469 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7b4c00b660 con 0x1dc8f40 2024-04-24T02:07:04.875 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.874+0000 7f7b5a7fc640 1 -- 172.21.15.57:0/104705469 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7b4c00b900 con 0x1dc8f40 2024-04-24T02:07:04.876 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.875+0000 7f7b6882cec0 1 -- 172.21.15.57:0/104705469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1dc8f40 msgr2=0x1db2640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:04.876 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.875+0000 7f7b6882cec0 1 --2- 172.21.15.57:0/104705469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1dc8f40 0x1db2640 crc :-1 s=READY pgs=12909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:04.877 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.875+0000 7f7b6882cec0 1 -- 172.21.15.57:0/104705469 shutdown_connections 2024-04-24T02:07:04.877 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.875+0000 7f7b6882cec0 1 --2- 172.21.15.57:0/104705469 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1dc8f40 0x1db2640 unknown :-1 s=CLOSED pgs=12909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:04.877 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.875+0000 7f7b6882cec0 1 -- 172.21.15.57:0/104705469 >> 172.21.15.57:0/104705469 conn(0x1ce7960 msgr2=0x1dce9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:07:04.877 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.875+0000 7f7b6882cec0 1 -- 172.21.15.57:0/104705469 shutdown_connections 2024-04-24T02:07:04.877 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.875+0000 7f7b6882cec0 1 -- 172.21.15.57:0/104705469 wait complete. 2024-04-24T02:07:04.877 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.876+0000 7f7b6882cec0 1 Processor -- start 2024-04-24T02:07:04.877 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.876+0000 7f7b6882cec0 1 -- start start 2024-04-24T02:07:04.879 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.878+0000 7f7b6882cec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1dc8f40 0x1e60c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:04.880 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.878+0000 7f7b6882cec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x1d2e3d0 con 0x1dc8f40 2024-04-24T02:07:04.880 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.878+0000 7f7b6099b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1dc8f40 0x1e60c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:04.880 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.878+0000 7f7b6099b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1dc8f40 0x1e60c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48188/0 (socket says 172.21.15.57:48188) 2024-04-24T02:07:04.880 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.878+0000 7f7b6099b640 1 -- 172.21.15.57:0/3900813597 learned_addr learned my addr 172.21.15.57:0/3900813597 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:07:04.880 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.878+0000 7f7b6099b640 1 -- 172.21.15.57:0/3900813597 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1cc1e30 con 0x1dc8f40 2024-04-24T02:07:04.880 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.878+0000 7f7b6099b640 1 --2- 172.21.15.57:0/3900813597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1dc8f40 0x1e60c60 crc :-1 s=READY pgs=12910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:04.880 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.878+0000 7f7b597fa640 1 -- 172.21.15.57:0/3900813597 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7b4c016040 con 0x1dc8f40 2024-04-24T02:07:04.880 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.878+0000 7f7b597fa640 1 -- 172.21.15.57:0/3900813597 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7b4c0119d0 con 0x1dc8f40 2024-04-24T02:07:04.880 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.878+0000 7f7b597fa640 1 -- 172.21.15.57:0/3900813597 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7b4c011c70 con 0x1dc8f40 2024-04-24T02:07:04.880 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.878+0000 7f7b6882cec0 1 -- 172.21.15.57:0/3900813597 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1cc1890 con 0x1dc8f40 2024-04-24T02:07:04.880 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.878+0000 7f7b6882cec0 1 -- 172.21.15.57:0/3900813597 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1e5c2f0 con 0x1dc8f40 2024-04-24T02:07:04.881 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.879+0000 7f7b597fa640 1 -- 172.21.15.57:0/3900813597 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f7b4c00e440 con 0x1dc8f40 2024-04-24T02:07:04.881 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.880+0000 7f7b597fa640 1 --2- 172.21.15.57:0/3900813597 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f7b480372b0 0x7f7b480397c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:04.881 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.880+0000 7f7b597fa640 1 -- 172.21.15.57:0/3900813597 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(706..706 src has 395..706) ==== 4179+0+0 (crc 0 0 0) 0x7f7b4c048f00 con 0x1dc8f40 2024-04-24T02:07:04.882 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.880+0000 7f7b6882cec0 1 --2- 172.21.15.57:0/3900813597 >> v2:172.21.15.84:6808/91137974 conn(0x1dca050 0x1e5af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:04.882 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.880+0000 7f7b6882cec0 1 -- 172.21.15.57:0/3900813597 --> v2:172.21.15.84:6808/91137974 -- osd_op(unknown.0.0:1 201.7 201:ff7b1f36:::obj1:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0x1e4d510 con 0x1dca050 2024-04-24T02:07:04.882 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.880+0000 7f7b5b7fe640 1 --2- 172.21.15.57:0/3900813597 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f7b480372b0 0x7f7b480397c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:04.882 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.881+0000 7f7b5b7fe640 1 --2- 172.21.15.57:0/3900813597 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f7b480372b0 0x7f7b480397c0 crc :-1 s=READY pgs=3943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:04.882 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.881+0000 7f7b6119c640 1 --2- 172.21.15.57:0/3900813597 >> v2:172.21.15.84:6808/91137974 conn(0x1dca050 0x1e5af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T02:07:04.886 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.884+0000 7f7b6119c640 1 --2- 172.21.15.57:0/3900813597 >> v2:172.21.15.84:6808/91137974 conn(0x1dca050 0x1e5af80 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:04.899 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.898+0000 7f7b6119c640 1 -- 172.21.15.57:0/3900813597 <== osd.3 v2:172.21.15.84:6808/91137974 1 ==== osd_op_reply(1 obj1 [writefull 0~11876] v706'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f7b5400a430 con 0x1dca050 2024-04-24T02:07:04.900 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.898+0000 7f7b6882cec0 1 -- 172.21.15.57:0/3900813597 >> v2:172.21.15.84:6808/91137974 conn(0x1dca050 msgr2=0x1e5af80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:04.900 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.898+0000 7f7b6882cec0 1 --2- 172.21.15.57:0/3900813597 >> v2:172.21.15.84:6808/91137974 conn(0x1dca050 0x1e5af80 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:04.900 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.898+0000 7f7b6882cec0 1 -- 172.21.15.57:0/3900813597 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f7b480372b0 msgr2=0x7f7b480397c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:04.900 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.898+0000 7f7b6882cec0 1 --2- 172.21.15.57:0/3900813597 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f7b480372b0 0x7f7b480397c0 crc :-1 s=READY pgs=3943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:04.900 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.898+0000 7f7b6882cec0 1 -- 172.21.15.57:0/3900813597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1dc8f40 msgr2=0x1e60c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:04.900 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.898+0000 7f7b6882cec0 1 --2- 172.21.15.57:0/3900813597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1dc8f40 0x1e60c60 crc :-1 s=READY pgs=12910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:04.900 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.898+0000 7f7b6882cec0 1 -- 172.21.15.57:0/3900813597 shutdown_connections 2024-04-24T02:07:04.900 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.898+0000 7f7b6882cec0 1 --2- 172.21.15.57:0/3900813597 >> v2:172.21.15.84:6808/91137974 conn(0x1dca050 0x1e5af80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:04.900 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.898+0000 7f7b6882cec0 1 --2- 172.21.15.57:0/3900813597 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f7b480372b0 0x7f7b480397c0 unknown :-1 s=CLOSED pgs=3943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:04.900 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.898+0000 7f7b6882cec0 1 --2- 172.21.15.57:0/3900813597 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1dc8f40 0x1e60c60 unknown :-1 s=CLOSED pgs=12910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:04.900 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.898+0000 7f7b6882cec0 1 -- 172.21.15.57:0/3900813597 >> 172.21.15.57:0/3900813597 conn(0x1ce7960 msgr2=0x1dce9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:07:04.901 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.898+0000 7f7b6882cec0 1 -- 172.21.15.57:0/3900813597 shutdown_connections 2024-04-24T02:07:04.901 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.898+0000 7f7b6882cec0 1 -- 172.21.15.57:0/3900813597 wait complete. 2024-04-24T02:07:04.902 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in `seq 1 10` 2024-04-24T02:07:04.902 INFO:tasks.workunit.client.0.smithi057.stderr:+ rados -p 09b3c512-40ed-4aad-9a96-edbc8decb8dc put obj2 /etc/passwd 2024-04-24T02:07:04.940 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.939+0000 7f0a34922ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:04.946 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.945+0000 7f0a34922ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:04.946 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.945+0000 7f0a34922ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:04.947 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.946+0000 7f0a34922ec0 1 Processor -- start 2024-04-24T02:07:04.947 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.946+0000 7f0a34922ec0 1 -- start start 2024-04-24T02:07:04.949 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.947+0000 7f0a34922ec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x19fff40 0x19e9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:04.949 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.947+0000 7f0a34922ec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x1967950 con 0x19fff40 2024-04-24T02:07:04.949 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.947+0000 7f0a2cd9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x19fff40 0x19e9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:04.949 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.947+0000 7f0a2cd9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x19fff40 0x19e9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48214/0 (socket says 172.21.15.57:48214) 2024-04-24T02:07:04.949 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.947+0000 7f0a2cd9b640 1 -- 172.21.15.57:0/799629960 learned_addr learned my addr 172.21.15.57:0/799629960 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:07:04.949 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.947+0000 7f0a2cd9b640 1 -- 172.21.15.57:0/799629960 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x19061e0 con 0x19fff40 2024-04-24T02:07:04.949 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.948+0000 7f0a2cd9b640 1 --2- 172.21.15.57:0/799629960 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x19fff40 0x19e9480 crc :-1 s=READY pgs=12913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b821c40a811dc12 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:04.950 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.948+0000 7f0a267fc640 1 -- 172.21.15.57:0/799629960 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0a200061e0 con 0x19fff40 2024-04-24T02:07:04.950 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.948+0000 7f0a267fc640 1 -- 172.21.15.57:0/799629960 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0a20006340 con 0x19fff40 2024-04-24T02:07:04.950 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.948+0000 7f0a267fc640 1 -- 172.21.15.57:0/799629960 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0a20001af0 con 0x19fff40 2024-04-24T02:07:04.951 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.948+0000 7f0a34922ec0 1 -- 172.21.15.57:0/799629960 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x19fff40 msgr2=0x19e9480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:04.951 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.948+0000 7f0a34922ec0 1 --2- 172.21.15.57:0/799629960 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x19fff40 0x19e9480 crc :-1 s=READY pgs=12913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:04.951 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.948+0000 7f0a34922ec0 1 -- 172.21.15.57:0/799629960 shutdown_connections 2024-04-24T02:07:04.951 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.948+0000 7f0a34922ec0 1 --2- 172.21.15.57:0/799629960 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x19fff40 0x19e9480 unknown :-1 s=CLOSED pgs=12913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:04.951 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.948+0000 7f0a34922ec0 1 -- 172.21.15.57:0/799629960 >> 172.21.15.57:0/799629960 conn(0x191e960 msgr2=0x1a059e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:07:04.951 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.948+0000 7f0a34922ec0 1 -- 172.21.15.57:0/799629960 shutdown_connections 2024-04-24T02:07:04.951 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.948+0000 7f0a34922ec0 1 -- 172.21.15.57:0/799629960 wait complete. 2024-04-24T02:07:04.951 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.949+0000 7f0a34922ec0 1 Processor -- start 2024-04-24T02:07:04.951 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.950+0000 7f0a34922ec0 1 -- start start 2024-04-24T02:07:04.953 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.951+0000 7f0a34922ec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x19fff40 0x1a921e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:04.953 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.951+0000 7f0a34922ec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x19653d0 con 0x19fff40 2024-04-24T02:07:04.953 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.951+0000 7f0a2cd9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x19fff40 0x1a921e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:04.953 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.951+0000 7f0a2cd9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x19fff40 0x1a921e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48226/0 (socket says 172.21.15.57:48226) 2024-04-24T02:07:04.953 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.951+0000 7f0a2cd9b640 1 -- 172.21.15.57:0/2209695393 learned_addr learned my addr 172.21.15.57:0/2209695393 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:07:04.953 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.951+0000 7f0a2cd9b640 1 -- 172.21.15.57:0/2209695393 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x18f8e30 con 0x19fff40 2024-04-24T02:07:04.954 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.951+0000 7f0a2cd9b640 1 --2- 172.21.15.57:0/2209695393 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x19fff40 0x1a921e0 crc :-1 s=READY pgs=12914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:04.954 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.952+0000 7f0a257fa640 1 -- 172.21.15.57:0/2209695393 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0a20004a60 con 0x19fff40 2024-04-24T02:07:04.954 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.952+0000 7f0a257fa640 1 -- 172.21.15.57:0/2209695393 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0a20004bc0 con 0x19fff40 2024-04-24T02:07:04.954 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.952+0000 7f0a34922ec0 1 -- 172.21.15.57:0/2209695393 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x18f8890 con 0x19fff40 2024-04-24T02:07:04.954 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.952+0000 7f0a257fa640 1 -- 172.21.15.57:0/2209695393 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0a20004e60 con 0x19fff40 2024-04-24T02:07:04.954 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.952+0000 7f0a34922ec0 1 -- 172.21.15.57:0/2209695393 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1a990c0 con 0x19fff40 2024-04-24T02:07:04.955 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.953+0000 7f0a257fa640 1 -- 172.21.15.57:0/2209695393 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f0a20014410 con 0x19fff40 2024-04-24T02:07:04.955 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.953+0000 7f0a257fa640 1 --2- 172.21.15.57:0/2209695393 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f0a14037210 0x7f0a14039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:04.956 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.953+0000 7f0a257fa640 1 -- 172.21.15.57:0/2209695393 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(706..706 src has 395..706) ==== 4179+0+0 (crc 0 0 0) 0x7f0a200489a0 con 0x19fff40 2024-04-24T02:07:04.956 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.953+0000 7f0a34922ec0 1 --2- 172.21.15.57:0/2209695393 >> v2:172.21.15.84:6805/1003835807 conn(0x1a01050 0x1a97e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:04.956 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.953+0000 7f0a34922ec0 1 -- 172.21.15.57:0/2209695393 --> v2:172.21.15.84:6805/1003835807 -- osd_op(unknown.0.0:1 201.8 201:104778fc:::obj2:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0x1a84640 con 0x1a01050 2024-04-24T02:07:04.956 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.953+0000 7f0a277fe640 1 --2- 172.21.15.57:0/2209695393 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f0a14037210 0x7f0a14039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:04.956 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.954+0000 7f0a277fe640 1 --2- 172.21.15.57:0/2209695393 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f0a14037210 0x7f0a14039720 crc :-1 s=READY pgs=3944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:04.956 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.954+0000 7f0a2d59c640 1 --2- 172.21.15.57:0/2209695393 >> v2:172.21.15.84:6805/1003835807 conn(0x1a01050 0x1a97e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T02:07:04.959 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.958+0000 7f0a2d59c640 1 --2- 172.21.15.57:0/2209695393 >> v2:172.21.15.84:6805/1003835807 conn(0x1a01050 0x1a97e80 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:04.972 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.970+0000 7f0a2d59c640 1 -- 172.21.15.57:0/2209695393 <== osd.2 v2:172.21.15.84:6805/1003835807 1 ==== osd_op_reply(1 obj2 [writefull 0~11876] v706'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f0a1800c430 con 0x1a01050 2024-04-24T02:07:04.972 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.970+0000 7f0a34922ec0 1 -- 172.21.15.57:0/2209695393 >> v2:172.21.15.84:6805/1003835807 conn(0x1a01050 msgr2=0x1a97e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:04.972 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.970+0000 7f0a34922ec0 1 --2- 172.21.15.57:0/2209695393 >> v2:172.21.15.84:6805/1003835807 conn(0x1a01050 0x1a97e80 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:04.972 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.970+0000 7f0a34922ec0 1 -- 172.21.15.57:0/2209695393 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f0a14037210 msgr2=0x7f0a14039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:04.972 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.970+0000 7f0a34922ec0 1 --2- 172.21.15.57:0/2209695393 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f0a14037210 0x7f0a14039720 crc :-1 s=READY pgs=3944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:04.972 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.970+0000 7f0a34922ec0 1 -- 172.21.15.57:0/2209695393 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x19fff40 msgr2=0x1a921e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:04.972 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.970+0000 7f0a34922ec0 1 --2- 172.21.15.57:0/2209695393 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x19fff40 0x1a921e0 crc :-1 s=READY pgs=12914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:04.972 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.970+0000 7f0a34922ec0 1 -- 172.21.15.57:0/2209695393 shutdown_connections 2024-04-24T02:07:04.973 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.970+0000 7f0a34922ec0 1 --2- 172.21.15.57:0/2209695393 >> v2:172.21.15.84:6805/1003835807 conn(0x1a01050 0x1a97e80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:04.973 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.970+0000 7f0a34922ec0 1 --2- 172.21.15.57:0/2209695393 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f0a14037210 0x7f0a14039720 unknown :-1 s=CLOSED pgs=3944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:04.973 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.970+0000 7f0a34922ec0 1 --2- 172.21.15.57:0/2209695393 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x19fff40 0x1a921e0 unknown :-1 s=CLOSED pgs=12914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:04.973 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.970+0000 7f0a34922ec0 1 -- 172.21.15.57:0/2209695393 >> 172.21.15.57:0/2209695393 conn(0x191e960 msgr2=0x1a062a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:07:04.973 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.970+0000 7f0a34922ec0 1 -- 172.21.15.57:0/2209695393 shutdown_connections 2024-04-24T02:07:04.973 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:04.971+0000 7f0a34922ec0 1 -- 172.21.15.57:0/2209695393 wait complete. 2024-04-24T02:07:04.974 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in `seq 1 10` 2024-04-24T02:07:04.974 INFO:tasks.workunit.client.0.smithi057.stderr:+ rados -p 09b3c512-40ed-4aad-9a96-edbc8decb8dc put obj3 /etc/passwd 2024-04-24T02:07:05.011 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.010+0000 7f16fda3bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:05.016 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.015+0000 7f16fda3bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:05.016 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.015+0000 7f16fda3bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:05.017 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.016+0000 7f16fda3bec0 1 Processor -- start 2024-04-24T02:07:05.017 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.016+0000 7f16fda3bec0 1 -- start start 2024-04-24T02:07:05.019 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.018+0000 7f16fda3bec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x14aabe0 0x14a6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.020 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.018+0000 7f16fda3bec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x1411950 con 0x14aabe0 2024-04-24T02:07:05.020 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.018+0000 7f16f5b9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x14aabe0 0x14a6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:05.020 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.018+0000 7f16f5b9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x14aabe0 0x14a6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48246/0 (socket says 172.21.15.57:48246) 2024-04-24T02:07:05.020 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.018+0000 7f16f5b9b640 1 -- 172.21.15.57:0/1602058895 learned_addr learned my addr 172.21.15.57:0/1602058895 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:07:05.020 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.018+0000 7f16f5b9b640 1 -- 172.21.15.57:0/1602058895 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x13b01e0 con 0x14aabe0 2024-04-24T02:07:05.020 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.018+0000 7f16f5b9b640 1 --2- 172.21.15.57:0/1602058895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x14aabe0 0x14a6580 crc :-1 s=READY pgs=12917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6866311378a8dd78 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.020 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.018+0000 7f16ef7fe640 1 -- 172.21.15.57:0/1602058895 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f16e002c460 con 0x14aabe0 2024-04-24T02:07:05.020 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.018+0000 7f16ef7fe640 1 -- 172.21.15.57:0/1602058895 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f16e000a040 con 0x14aabe0 2024-04-24T02:07:05.020 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.018+0000 7f16ef7fe640 1 -- 172.21.15.57:0/1602058895 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f16e000a1b0 con 0x14aabe0 2024-04-24T02:07:05.021 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.019+0000 7f16fda3bec0 1 -- 172.21.15.57:0/1602058895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x14aabe0 msgr2=0x14a6580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.022 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.019+0000 7f16fda3bec0 1 --2- 172.21.15.57:0/1602058895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x14aabe0 0x14a6580 crc :-1 s=READY pgs=12917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.022 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.019+0000 7f16fda3bec0 1 -- 172.21.15.57:0/1602058895 shutdown_connections 2024-04-24T02:07:05.022 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.019+0000 7f16fda3bec0 1 --2- 172.21.15.57:0/1602058895 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x14aabe0 0x14a6580 unknown :-1 s=CLOSED pgs=12917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.022 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.019+0000 7f16fda3bec0 1 -- 172.21.15.57:0/1602058895 >> 172.21.15.57:0/1602058895 conn(0x13c8960 msgr2=0x15c6420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:07:05.022 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.019+0000 7f16fda3bec0 1 -- 172.21.15.57:0/1602058895 shutdown_connections 2024-04-24T02:07:05.022 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.019+0000 7f16fda3bec0 1 -- 172.21.15.57:0/1602058895 wait complete. 2024-04-24T02:07:05.022 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.020+0000 7f16fda3bec0 1 Processor -- start 2024-04-24T02:07:05.022 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.020+0000 7f16fda3bec0 1 -- start start 2024-04-24T02:07:05.024 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.022+0000 7f16fda3bec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x14aabe0 0x15b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.024 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.022+0000 7f16fda3bec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x140f3d0 con 0x14aabe0 2024-04-24T02:07:05.024 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.022+0000 7f16f5b9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x14aabe0 0x15b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:05.024 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.022+0000 7f16f5b9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x14aabe0 0x15b24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48260/0 (socket says 172.21.15.57:48260) 2024-04-24T02:07:05.024 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.022+0000 7f16f5b9b640 1 -- 172.21.15.57:0/3102850124 learned_addr learned my addr 172.21.15.57:0/3102850124 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:07:05.024 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.022+0000 7f16f5b9b640 1 -- 172.21.15.57:0/3102850124 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x13a2e30 con 0x14aabe0 2024-04-24T02:07:05.024 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.022+0000 7f16f5b9b640 1 --2- 172.21.15.57:0/3102850124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x14aabe0 0x15b24b0 crc :-1 s=READY pgs=12918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.024 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.022+0000 7f16ee7fc640 1 -- 172.21.15.57:0/3102850124 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f16e002d570 con 0x14aabe0 2024-04-24T02:07:05.024 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.022+0000 7f16ee7fc640 1 -- 172.21.15.57:0/3102850124 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f16e002d6d0 con 0x14aabe0 2024-04-24T02:07:05.024 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.022+0000 7f16fda3bec0 1 -- 172.21.15.57:0/3102850124 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x13a2890 con 0x14aabe0 2024-04-24T02:07:05.024 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.022+0000 7f16ee7fc640 1 -- 172.21.15.57:0/3102850124 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f16e002d970 con 0x14aabe0 2024-04-24T02:07:05.025 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.022+0000 7f16fda3bec0 1 -- 172.21.15.57:0/3102850124 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x15b4da0 con 0x14aabe0 2024-04-24T02:07:05.026 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.023+0000 7f16ee7fc640 1 -- 172.21.15.57:0/3102850124 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f16e0035040 con 0x14aabe0 2024-04-24T02:07:05.026 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.023+0000 7f16ee7fc640 1 --2- 172.21.15.57:0/3102850124 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f16dc037210 0x7f16dc039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.026 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.024+0000 7f16ee7fc640 1 -- 172.21.15.57:0/3102850124 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(706..706 src has 395..706) ==== 4179+0+0 (crc 0 0 0) 0x7f16e0032040 con 0x14aabe0 2024-04-24T02:07:05.026 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.024+0000 7f16fda3bec0 1 --2- 172.21.15.57:0/3102850124 >> v2:172.21.15.57:6805/2600611357 conn(0x14aca80 0x15d47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.026 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.024+0000 7f16fda3bec0 1 -- 172.21.15.57:0/3102850124 --> v2:172.21.15.57:6805/2600611357 -- osd_op(unknown.0.0:1 201.1 201:8dd16f86:::obj3:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0x15c65a0 con 0x14aca80 2024-04-24T02:07:05.026 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.024+0000 7f16f539a640 1 --2- 172.21.15.57:0/3102850124 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f16dc037210 0x7f16dc039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:05.026 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.024+0000 7f16f539a640 1 --2- 172.21.15.57:0/3102850124 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f16dc037210 0x7f16dc039720 crc :-1 s=READY pgs=3945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.026 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.025+0000 7f16f639c640 1 --2- 172.21.15.57:0/3102850124 >> v2:172.21.15.57:6805/2600611357 conn(0x14aca80 0x15d47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T02:07:05.029 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.028+0000 7f16f639c640 1 --2- 172.21.15.57:0/3102850124 >> v2:172.21.15.57:6805/2600611357 conn(0x14aca80 0x15d47f0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.042 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.039+0000 7f16f639c640 1 -- 172.21.15.57:0/3102850124 <== osd.1 v2:172.21.15.57:6805/2600611357 1 ==== osd_op_reply(1 obj3 [writefull 0~11876] v706'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f16e800a430 con 0x14aca80 2024-04-24T02:07:05.042 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.039+0000 7f16fda3bec0 1 -- 172.21.15.57:0/3102850124 >> v2:172.21.15.57:6805/2600611357 conn(0x14aca80 msgr2=0x15d47f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.042 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.039+0000 7f16fda3bec0 1 --2- 172.21.15.57:0/3102850124 >> v2:172.21.15.57:6805/2600611357 conn(0x14aca80 0x15d47f0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.042 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.040+0000 7f16fda3bec0 1 -- 172.21.15.57:0/3102850124 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f16dc037210 msgr2=0x7f16dc039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.042 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.040+0000 7f16fda3bec0 1 --2- 172.21.15.57:0/3102850124 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f16dc037210 0x7f16dc039720 crc :-1 s=READY pgs=3945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.042 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.040+0000 7f16fda3bec0 1 -- 172.21.15.57:0/3102850124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x14aabe0 msgr2=0x15b24b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.043 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.040+0000 7f16fda3bec0 1 --2- 172.21.15.57:0/3102850124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x14aabe0 0x15b24b0 crc :-1 s=READY pgs=12918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.043 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.040+0000 7f16fda3bec0 1 -- 172.21.15.57:0/3102850124 shutdown_connections 2024-04-24T02:07:05.043 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.040+0000 7f16fda3bec0 1 --2- 172.21.15.57:0/3102850124 >> v2:172.21.15.57:6805/2600611357 conn(0x14aca80 0x15d47f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.043 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.040+0000 7f16fda3bec0 1 --2- 172.21.15.57:0/3102850124 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f16dc037210 0x7f16dc039720 unknown :-1 s=CLOSED pgs=3945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.043 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.040+0000 7f16fda3bec0 1 --2- 172.21.15.57:0/3102850124 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x14aabe0 0x15b24b0 unknown :-1 s=CLOSED pgs=12918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.043 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.040+0000 7f16fda3bec0 1 -- 172.21.15.57:0/3102850124 >> 172.21.15.57:0/3102850124 conn(0x13c8960 msgr2=0x14a6350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:07:05.043 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.040+0000 7f16fda3bec0 1 -- 172.21.15.57:0/3102850124 shutdown_connections 2024-04-24T02:07:05.043 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.040+0000 7f16fda3bec0 1 -- 172.21.15.57:0/3102850124 wait complete. 2024-04-24T02:07:05.043 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in `seq 1 10` 2024-04-24T02:07:05.044 INFO:tasks.workunit.client.0.smithi057.stderr:+ rados -p 09b3c512-40ed-4aad-9a96-edbc8decb8dc put obj4 /etc/passwd 2024-04-24T02:07:05.080 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.079+0000 7f764865bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:05.086 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.085+0000 7f764865bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:05.086 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.085+0000 7f764865bec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:05.087 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.086+0000 7f764865bec0 1 Processor -- start 2024-04-24T02:07:05.087 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.086+0000 7f764865bec0 1 -- start start 2024-04-24T02:07:05.089 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.087+0000 7f764865bec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1734050 0x1739410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.089 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.087+0000 7f764865bec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x169a950 con 0x1734050 2024-04-24T02:07:05.089 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.087+0000 7f763b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1734050 0x1739410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:05.089 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.087+0000 7f763b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1734050 0x1739410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48284/0 (socket says 172.21.15.57:48284) 2024-04-24T02:07:05.089 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.087+0000 7f763b7fe640 1 -- 172.21.15.57:0/1162765666 learned_addr learned my addr 172.21.15.57:0/1162765666 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:07:05.089 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.088+0000 7f763b7fe640 1 -- 172.21.15.57:0/1162765666 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x16391e0 con 0x1734050 2024-04-24T02:07:05.090 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.088+0000 7f763b7fe640 1 --2- 172.21.15.57:0/1162765666 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1734050 0x1739410 crc :-1 s=READY pgs=12921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e075c7892741d70 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.090 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.088+0000 7f7639ffb640 1 -- 172.21.15.57:0/1162765666 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f762c032040 con 0x1734050 2024-04-24T02:07:05.090 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.088+0000 7f7639ffb640 1 -- 172.21.15.57:0/1162765666 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f762c00a040 con 0x1734050 2024-04-24T02:07:05.090 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.088+0000 7f7639ffb640 1 -- 172.21.15.57:0/1162765666 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f762c00a2e0 con 0x1734050 2024-04-24T02:07:05.091 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.089+0000 7f764865bec0 1 -- 172.21.15.57:0/1162765666 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1734050 msgr2=0x1739410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.091 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.089+0000 7f764865bec0 1 --2- 172.21.15.57:0/1162765666 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1734050 0x1739410 crc :-1 s=READY pgs=12921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.091 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.089+0000 7f764865bec0 1 -- 172.21.15.57:0/1162765666 shutdown_connections 2024-04-24T02:07:05.091 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.089+0000 7f764865bec0 1 --2- 172.21.15.57:0/1162765666 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1734050 0x1739410 unknown :-1 s=CLOSED pgs=12921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.091 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.089+0000 7f764865bec0 1 -- 172.21.15.57:0/1162765666 >> 172.21.15.57:0/1162765666 conn(0x1651960 msgr2=0x184d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:07:05.091 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.089+0000 7f764865bec0 1 -- 172.21.15.57:0/1162765666 shutdown_connections 2024-04-24T02:07:05.091 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.089+0000 7f764865bec0 1 -- 172.21.15.57:0/1162765666 wait complete. 2024-04-24T02:07:05.091 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.090+0000 7f764865bec0 1 Processor -- start 2024-04-24T02:07:05.091 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.090+0000 7f764865bec0 1 -- start start 2024-04-24T02:07:05.093 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.091+0000 7f764865bec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1734050 0x17b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.093 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.091+0000 7f764865bec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x16983d0 con 0x1734050 2024-04-24T02:07:05.093 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.091+0000 7f763b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1734050 0x17b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:05.093 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.091+0000 7f763b7fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1734050 0x17b25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48300/0 (socket says 172.21.15.57:48300) 2024-04-24T02:07:05.093 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.091+0000 7f763b7fe640 1 -- 172.21.15.57:0/2017876731 learned_addr learned my addr 172.21.15.57:0/2017876731 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:07:05.093 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.091+0000 7f763b7fe640 1 -- 172.21.15.57:0/2017876731 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x162be30 con 0x1734050 2024-04-24T02:07:05.094 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.092+0000 7f763b7fe640 1 --2- 172.21.15.57:0/2017876731 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1734050 0x17b25b0 crc :-1 s=READY pgs=12922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.094 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.092+0000 7f7638ff9640 1 -- 172.21.15.57:0/2017876731 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f762c02d570 con 0x1734050 2024-04-24T02:07:05.094 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.092+0000 7f7638ff9640 1 -- 172.21.15.57:0/2017876731 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f762c02d6d0 con 0x1734050 2024-04-24T02:07:05.094 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.092+0000 7f764865bec0 1 -- 172.21.15.57:0/2017876731 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x162b890 con 0x1734050 2024-04-24T02:07:05.094 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.092+0000 7f7638ff9640 1 -- 172.21.15.57:0/2017876731 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f762c02d970 con 0x1734050 2024-04-24T02:07:05.094 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.092+0000 7f764865bec0 1 -- 172.21.15.57:0/2017876731 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x17b58e0 con 0x1734050 2024-04-24T02:07:05.095 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.093+0000 7f7638ff9640 1 -- 172.21.15.57:0/2017876731 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f762c02db60 con 0x1734050 2024-04-24T02:07:05.095 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.093+0000 7f7638ff9640 1 --2- 172.21.15.57:0/2017876731 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f7628037210 0x7f7628039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.095 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.093+0000 7f7638ff9640 1 -- 172.21.15.57:0/2017876731 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(706..706 src has 395..706) ==== 4179+0+0 (crc 0 0 0) 0x7f762c032040 con 0x1734050 2024-04-24T02:07:05.095 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.093+0000 7f764865bec0 1 --2- 172.21.15.57:0/2017876731 >> v2:172.21.15.84:6808/91137974 conn(0x1734e20 0x17b3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.095 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.093+0000 7f764865bec0 1 -- 172.21.15.57:0/2017876731 --> v2:172.21.15.84:6808/91137974 -- osd_op(unknown.0.0:1 201.0 201:0ee9ae15:::obj4:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0x17b6080 con 0x1734e20 2024-04-24T02:07:05.095 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.093+0000 7f763affd640 1 --2- 172.21.15.57:0/2017876731 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f7628037210 0x7f7628039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:05.095 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.094+0000 7f763affd640 1 --2- 172.21.15.57:0/2017876731 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f7628037210 0x7f7628039720 crc :-1 s=READY pgs=3946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.096 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.094+0000 7f763bfff640 1 --2- 172.21.15.57:0/2017876731 >> v2:172.21.15.84:6808/91137974 conn(0x1734e20 0x17b3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T02:07:05.100 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.098+0000 7f763bfff640 1 --2- 172.21.15.57:0/2017876731 >> v2:172.21.15.84:6808/91137974 conn(0x1734e20 0x17b3000 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.113 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.111+0000 7f763bfff640 1 -- 172.21.15.57:0/2017876731 <== osd.3 v2:172.21.15.84:6808/91137974 1 ==== osd_op_reply(1 obj4 [writefull 0~11876] v706'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f763400a430 con 0x1734e20 2024-04-24T02:07:05.113 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.111+0000 7f764865bec0 1 -- 172.21.15.57:0/2017876731 >> v2:172.21.15.84:6808/91137974 conn(0x1734e20 msgr2=0x17b3000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.113 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.111+0000 7f764865bec0 1 --2- 172.21.15.57:0/2017876731 >> v2:172.21.15.84:6808/91137974 conn(0x1734e20 0x17b3000 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.113 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.111+0000 7f764865bec0 1 -- 172.21.15.57:0/2017876731 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f7628037210 msgr2=0x7f7628039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.114 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.111+0000 7f764865bec0 1 --2- 172.21.15.57:0/2017876731 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f7628037210 0x7f7628039720 crc :-1 s=READY pgs=3946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.114 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.111+0000 7f764865bec0 1 -- 172.21.15.57:0/2017876731 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1734050 msgr2=0x17b25b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.114 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.111+0000 7f764865bec0 1 --2- 172.21.15.57:0/2017876731 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1734050 0x17b25b0 crc :-1 s=READY pgs=12922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.114 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.111+0000 7f764865bec0 1 -- 172.21.15.57:0/2017876731 shutdown_connections 2024-04-24T02:07:05.114 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.111+0000 7f764865bec0 1 --2- 172.21.15.57:0/2017876731 >> v2:172.21.15.84:6808/91137974 conn(0x1734e20 0x17b3000 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.114 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.111+0000 7f764865bec0 1 --2- 172.21.15.57:0/2017876731 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f7628037210 0x7f7628039720 unknown :-1 s=CLOSED pgs=3946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.114 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.111+0000 7f764865bec0 1 --2- 172.21.15.57:0/2017876731 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1734050 0x17b25b0 unknown :-1 s=CLOSED pgs=12922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.114 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.111+0000 7f764865bec0 1 -- 172.21.15.57:0/2017876731 >> 172.21.15.57:0/2017876731 conn(0x1651960 msgr2=0x184d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:07:05.114 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.112+0000 7f764865bec0 1 -- 172.21.15.57:0/2017876731 shutdown_connections 2024-04-24T02:07:05.114 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.112+0000 7f764865bec0 1 -- 172.21.15.57:0/2017876731 wait complete. 2024-04-24T02:07:05.115 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in `seq 1 10` 2024-04-24T02:07:05.115 INFO:tasks.workunit.client.0.smithi057.stderr:+ rados -p 09b3c512-40ed-4aad-9a96-edbc8decb8dc put obj5 /etc/passwd 2024-04-24T02:07:05.151 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.150+0000 7f43f7c2cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:05.159 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.156+0000 7f43f7c2cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:05.159 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.156+0000 7f43f7c2cec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:05.159 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.157+0000 7f43f7c2cec0 1 Processor -- start 2024-04-24T02:07:05.159 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.157+0000 7f43f7c2cec0 1 -- start start 2024-04-24T02:07:05.160 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.158+0000 7f43f7c2cec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1443050 0x14d5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.160 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.158+0000 7f43f7c2cec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x13a9950 con 0x1443050 2024-04-24T02:07:05.160 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.158+0000 7f43eaffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1443050 0x14d5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:05.160 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.158+0000 7f43eaffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1443050 0x14d5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48312/0 (socket says 172.21.15.57:48312) 2024-04-24T02:07:05.160 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.158+0000 7f43eaffd640 1 -- 172.21.15.57:0/714011367 learned_addr learned my addr 172.21.15.57:0/714011367 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:07:05.161 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.159+0000 7f43eaffd640 1 -- 172.21.15.57:0/714011367 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x13481e0 con 0x1443050 2024-04-24T02:07:05.161 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.159+0000 7f43eaffd640 1 --2- 172.21.15.57:0/714011367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1443050 0x14d5750 crc :-1 s=READY pgs=12925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31b0ebdf65d84360 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.161 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.159+0000 7f43e97fa640 1 -- 172.21.15.57:0/714011367 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f43e4032040 con 0x1443050 2024-04-24T02:07:05.161 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.159+0000 7f43e97fa640 1 -- 172.21.15.57:0/714011367 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f43e400a170 con 0x1443050 2024-04-24T02:07:05.161 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.159+0000 7f43e97fa640 1 -- 172.21.15.57:0/714011367 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f43e402cb40 con 0x1443050 2024-04-24T02:07:05.162 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.160+0000 7f43f7c2cec0 1 -- 172.21.15.57:0/714011367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1443050 msgr2=0x14d5750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.162 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.160+0000 7f43f7c2cec0 1 --2- 172.21.15.57:0/714011367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1443050 0x14d5750 crc :-1 s=READY pgs=12925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.162 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.160+0000 7f43f7c2cec0 1 -- 172.21.15.57:0/714011367 shutdown_connections 2024-04-24T02:07:05.162 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.160+0000 7f43f7c2cec0 1 --2- 172.21.15.57:0/714011367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1443050 0x14d5750 unknown :-1 s=CLOSED pgs=12925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.162 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.160+0000 7f43f7c2cec0 1 -- 172.21.15.57:0/714011367 >> 172.21.15.57:0/714011367 conn(0x1360960 msgr2=0x155c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:07:05.162 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.160+0000 7f43f7c2cec0 1 -- 172.21.15.57:0/714011367 shutdown_connections 2024-04-24T02:07:05.162 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.160+0000 7f43f7c2cec0 1 -- 172.21.15.57:0/714011367 wait complete. 2024-04-24T02:07:05.162 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.161+0000 7f43f7c2cec0 1 Processor -- start 2024-04-24T02:07:05.162 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.161+0000 7f43f7c2cec0 1 -- start start 2024-04-24T02:07:05.164 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.162+0000 7f43f7c2cec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1443050 0x14c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.164 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.162+0000 7f43f7c2cec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x13a73d0 con 0x1443050 2024-04-24T02:07:05.164 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.162+0000 7f43eaffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1443050 0x14c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:05.164 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.162+0000 7f43eaffd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1443050 0x14c4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48322/0 (socket says 172.21.15.57:48322) 2024-04-24T02:07:05.164 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.162+0000 7f43eaffd640 1 -- 172.21.15.57:0/552645885 learned_addr learned my addr 172.21.15.57:0/552645885 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:07:05.164 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.163+0000 7f43eaffd640 1 -- 172.21.15.57:0/552645885 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x133ae30 con 0x1443050 2024-04-24T02:07:05.164 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.163+0000 7f43eaffd640 1 --2- 172.21.15.57:0/552645885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1443050 0x14c4640 crc :-1 s=READY pgs=12926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.165 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.163+0000 7f43e3fff640 1 -- 172.21.15.57:0/552645885 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f43e402cb40 con 0x1443050 2024-04-24T02:07:05.165 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.163+0000 7f43e3fff640 1 -- 172.21.15.57:0/552645885 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f43e402c580 con 0x1443050 2024-04-24T02:07:05.165 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.163+0000 7f43f7c2cec0 1 -- 172.21.15.57:0/552645885 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x133a890 con 0x1443050 2024-04-24T02:07:05.165 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.163+0000 7f43e3fff640 1 -- 172.21.15.57:0/552645885 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f43e402dc00 con 0x1443050 2024-04-24T02:07:05.165 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.163+0000 7f43f7c2cec0 1 -- 172.21.15.57:0/552645885 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x14c69c0 con 0x1443050 2024-04-24T02:07:05.166 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.164+0000 7f43e3fff640 1 -- 172.21.15.57:0/552645885 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f43e40393f0 con 0x1443050 2024-04-24T02:07:05.166 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.164+0000 7f43e3fff640 1 --2- 172.21.15.57:0/552645885 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f43cc037210 0x7f43cc039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.166 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.164+0000 7f43e3fff640 1 -- 172.21.15.57:0/552645885 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(706..706 src has 395..706) ==== 4179+0+0 (crc 0 0 0) 0x7f43e4032040 con 0x1443050 2024-04-24T02:07:05.166 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.164+0000 7f43f7c2cec0 1 --2- 172.21.15.57:0/552645885 >> v2:172.21.15.57:6801/2208289758 conn(0x1443e20 0x14d4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.166 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.164+0000 7f43f7c2cec0 1 -- 172.21.15.57:0/552645885 --> v2:172.21.15.57:6801/2208289758 -- osd_op(unknown.0.0:1 201.3 201:c52c9666:::obj5:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0x143f6b0 con 0x1443e20 2024-04-24T02:07:05.166 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.164+0000 7f43ea7fc640 1 --2- 172.21.15.57:0/552645885 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f43cc037210 0x7f43cc039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:05.166 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.165+0000 7f43ea7fc640 1 --2- 172.21.15.57:0/552645885 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f43cc037210 0x7f43cc039720 crc :-1 s=READY pgs=3947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.166 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.165+0000 7f43eb7fe640 1 --2- 172.21.15.57:0/552645885 >> v2:172.21.15.57:6801/2208289758 conn(0x1443e20 0x14d4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T02:07:05.168 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.167+0000 7f43eb7fe640 1 --2- 172.21.15.57:0/552645885 >> v2:172.21.15.57:6801/2208289758 conn(0x1443e20 0x14d4b90 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.181 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.179+0000 7f43eb7fe640 1 -- 172.21.15.57:0/552645885 <== osd.0 v2:172.21.15.57:6801/2208289758 1 ==== osd_op_reply(1 obj5 [writefull 0~11876] v706'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f43dc00a430 con 0x1443e20 2024-04-24T02:07:05.181 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.179+0000 7f43f7c2cec0 1 -- 172.21.15.57:0/552645885 >> v2:172.21.15.57:6801/2208289758 conn(0x1443e20 msgr2=0x14d4b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.181 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.179+0000 7f43f7c2cec0 1 --2- 172.21.15.57:0/552645885 >> v2:172.21.15.57:6801/2208289758 conn(0x1443e20 0x14d4b90 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.181 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.179+0000 7f43f7c2cec0 1 -- 172.21.15.57:0/552645885 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f43cc037210 msgr2=0x7f43cc039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.181 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.179+0000 7f43f7c2cec0 1 --2- 172.21.15.57:0/552645885 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f43cc037210 0x7f43cc039720 crc :-1 s=READY pgs=3947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.181 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.179+0000 7f43f7c2cec0 1 -- 172.21.15.57:0/552645885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1443050 msgr2=0x14c4640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.181 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.179+0000 7f43f7c2cec0 1 --2- 172.21.15.57:0/552645885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1443050 0x14c4640 crc :-1 s=READY pgs=12926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.181 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.179+0000 7f43f7c2cec0 1 -- 172.21.15.57:0/552645885 shutdown_connections 2024-04-24T02:07:05.182 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.179+0000 7f43f7c2cec0 1 --2- 172.21.15.57:0/552645885 >> v2:172.21.15.57:6801/2208289758 conn(0x1443e20 0x14d4b90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.182 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.179+0000 7f43f7c2cec0 1 --2- 172.21.15.57:0/552645885 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f43cc037210 0x7f43cc039720 unknown :-1 s=CLOSED pgs=3947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.182 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.179+0000 7f43f7c2cec0 1 --2- 172.21.15.57:0/552645885 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1443050 0x14c4640 unknown :-1 s=CLOSED pgs=12926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.182 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.179+0000 7f43f7c2cec0 1 -- 172.21.15.57:0/552645885 >> 172.21.15.57:0/552645885 conn(0x1360960 msgr2=0x155c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:07:05.182 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.179+0000 7f43f7c2cec0 1 -- 172.21.15.57:0/552645885 shutdown_connections 2024-04-24T02:07:05.182 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.179+0000 7f43f7c2cec0 1 -- 172.21.15.57:0/552645885 wait complete. 2024-04-24T02:07:05.183 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in `seq 1 10` 2024-04-24T02:07:05.183 INFO:tasks.workunit.client.0.smithi057.stderr:+ rados -p 09b3c512-40ed-4aad-9a96-edbc8decb8dc put obj6 /etc/passwd 2024-04-24T02:07:05.220 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.218+0000 7feab4c2fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:05.225 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.224+0000 7feab4c2fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:05.225 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.224+0000 7feab4c2fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:05.226 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.225+0000 7feab4c2fec0 1 Processor -- start 2024-04-24T02:07:05.226 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.225+0000 7feab4c2fec0 1 -- start start 2024-04-24T02:07:05.228 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.226+0000 7feab4c2fec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x6d7aa0 0x770880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.228 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.226+0000 7feab4c2fec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x641950 con 0x6d7aa0 2024-04-24T02:07:05.228 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.226+0000 7feaa7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x6d7aa0 0x770880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:05.228 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.227+0000 7feaa7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x6d7aa0 0x770880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48336/0 (socket says 172.21.15.57:48336) 2024-04-24T02:07:05.229 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.227+0000 7feaa7fff640 1 -- 172.21.15.57:0/3169887907 learned_addr learned my addr 172.21.15.57:0/3169887907 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:07:05.229 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.227+0000 7feaa7fff640 1 -- 172.21.15.57:0/3169887907 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5e01e0 con 0x6d7aa0 2024-04-24T02:07:05.229 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.227+0000 7feaa7fff640 1 --2- 172.21.15.57:0/3169887907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x6d7aa0 0x770880 crc :-1 s=READY pgs=12929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c448bb28f4cf6eae server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.229 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.227+0000 7feaa67fc640 1 -- 172.21.15.57:0/3169887907 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fea9800c490 con 0x6d7aa0 2024-04-24T02:07:05.229 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.227+0000 7feaa67fc640 1 -- 172.21.15.57:0/3169887907 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fea9800c5f0 con 0x6d7aa0 2024-04-24T02:07:05.229 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.227+0000 7feaa67fc640 1 -- 172.21.15.57:0/3169887907 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fea9800c890 con 0x6d7aa0 2024-04-24T02:07:05.230 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.228+0000 7feab4c2fec0 1 -- 172.21.15.57:0/3169887907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x6d7aa0 msgr2=0x770880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.230 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.228+0000 7feab4c2fec0 1 --2- 172.21.15.57:0/3169887907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x6d7aa0 0x770880 crc :-1 s=READY pgs=12929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.230 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.228+0000 7feab4c2fec0 1 -- 172.21.15.57:0/3169887907 shutdown_connections 2024-04-24T02:07:05.230 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.228+0000 7feab4c2fec0 1 --2- 172.21.15.57:0/3169887907 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x6d7aa0 0x770880 unknown :-1 s=CLOSED pgs=12929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.230 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.228+0000 7feab4c2fec0 1 -- 172.21.15.57:0/3169887907 >> 172.21.15.57:0/3169887907 conn(0x5f8960 msgr2=0x6d3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:07:05.230 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.228+0000 7feab4c2fec0 1 -- 172.21.15.57:0/3169887907 shutdown_connections 2024-04-24T02:07:05.230 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.228+0000 7feab4c2fec0 1 -- 172.21.15.57:0/3169887907 wait complete. 2024-04-24T02:07:05.230 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.229+0000 7feab4c2fec0 1 Processor -- start 2024-04-24T02:07:05.230 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.229+0000 7feab4c2fec0 1 -- start start 2024-04-24T02:07:05.233 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.230+0000 7feab4c2fec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x6d7aa0 0x7fb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.233 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.230+0000 7feab4c2fec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x63f3d0 con 0x6d7aa0 2024-04-24T02:07:05.233 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.230+0000 7feaa7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x6d7aa0 0x7fb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:05.233 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.230+0000 7feaa7fff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x6d7aa0 0x7fb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48338/0 (socket says 172.21.15.57:48338) 2024-04-24T02:07:05.233 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.230+0000 7feaa7fff640 1 -- 172.21.15.57:0/4202184604 learned_addr learned my addr 172.21.15.57:0/4202184604 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:07:05.233 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.231+0000 7feaa7fff640 1 -- 172.21.15.57:0/4202184604 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5d2e30 con 0x6d7aa0 2024-04-24T02:07:05.233 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.231+0000 7feaa7fff640 1 --2- 172.21.15.57:0/4202184604 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x6d7aa0 0x7fb190 crc :-1 s=READY pgs=12930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.233 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.231+0000 7feaa57fa640 1 -- 172.21.15.57:0/4202184604 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fea98016040 con 0x6d7aa0 2024-04-24T02:07:05.233 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.231+0000 7feaa57fa640 1 -- 172.21.15.57:0/4202184604 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fea98011900 con 0x6d7aa0 2024-04-24T02:07:05.233 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.231+0000 7feab4c2fec0 1 -- 172.21.15.57:0/4202184604 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5d2890 con 0x6d7aa0 2024-04-24T02:07:05.233 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.231+0000 7feaa57fa640 1 -- 172.21.15.57:0/4202184604 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fea98011ba0 con 0x6d7aa0 2024-04-24T02:07:05.233 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.231+0000 7feab4c2fec0 1 -- 172.21.15.57:0/4202184604 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff570 con 0x6d7aa0 2024-04-24T02:07:05.235 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.232+0000 7feaa57fa640 1 -- 172.21.15.57:0/4202184604 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fea98011d50 con 0x6d7aa0 2024-04-24T02:07:05.235 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.232+0000 7feaa57fa640 1 --2- 172.21.15.57:0/4202184604 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fea94037210 0x7fea94039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.235 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.232+0000 7feaa57fa640 1 -- 172.21.15.57:0/4202184604 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(706..706 src has 395..706) ==== 4179+0+0 (crc 0 0 0) 0x7fea98049080 con 0x6d7aa0 2024-04-24T02:07:05.236 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.232+0000 7feab4c2fec0 1 --2- 172.21.15.57:0/4202184604 >> v2:172.21.15.57:6805/2600611357 conn(0xc07db0 0xc0a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.236 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.232+0000 7feab4c2fec0 1 -- 172.21.15.57:0/4202184604 --> v2:172.21.15.57:6805/2600611357 -- osd_op(unknown.0.0:1 201.4 201:233a42c1:::obj6:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0x7fecc0 con 0xc07db0 2024-04-24T02:07:05.236 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.233+0000 7feaa77fe640 1 --2- 172.21.15.57:0/4202184604 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fea94037210 0x7fea94039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:05.236 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.233+0000 7feaa77fe640 1 --2- 172.21.15.57:0/4202184604 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fea94037210 0x7fea94039720 crc :-1 s=READY pgs=3948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.236 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.233+0000 7feaacd9b640 1 --2- 172.21.15.57:0/4202184604 >> v2:172.21.15.57:6805/2600611357 conn(0xc07db0 0xc0a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T02:07:05.238 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.237+0000 7feaacd9b640 1 --2- 172.21.15.57:0/4202184604 >> v2:172.21.15.57:6805/2600611357 conn(0xc07db0 0xc0a1d0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.252 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.249+0000 7feaacd9b640 1 -- 172.21.15.57:0/4202184604 <== osd.1 v2:172.21.15.57:6805/2600611357 1 ==== osd_op_reply(1 obj6 [writefull 0~11876] v706'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7feaa000a430 con 0xc07db0 2024-04-24T02:07:05.252 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.249+0000 7feab4c2fec0 1 -- 172.21.15.57:0/4202184604 >> v2:172.21.15.57:6805/2600611357 conn(0xc07db0 msgr2=0xc0a1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.252 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.249+0000 7feab4c2fec0 1 --2- 172.21.15.57:0/4202184604 >> v2:172.21.15.57:6805/2600611357 conn(0xc07db0 0xc0a1d0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.252 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.249+0000 7feab4c2fec0 1 -- 172.21.15.57:0/4202184604 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fea94037210 msgr2=0x7fea94039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.252 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.249+0000 7feab4c2fec0 1 --2- 172.21.15.57:0/4202184604 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fea94037210 0x7fea94039720 crc :-1 s=READY pgs=3948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.252 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.249+0000 7feab4c2fec0 1 -- 172.21.15.57:0/4202184604 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x6d7aa0 msgr2=0x7fb190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.252 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.249+0000 7feab4c2fec0 1 --2- 172.21.15.57:0/4202184604 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x6d7aa0 0x7fb190 crc :-1 s=READY pgs=12930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.252 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.249+0000 7feab4c2fec0 1 -- 172.21.15.57:0/4202184604 shutdown_connections 2024-04-24T02:07:05.253 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.249+0000 7feab4c2fec0 1 --2- 172.21.15.57:0/4202184604 >> v2:172.21.15.57:6805/2600611357 conn(0xc07db0 0xc0a1d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.253 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.249+0000 7feab4c2fec0 1 --2- 172.21.15.57:0/4202184604 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fea94037210 0x7fea94039720 unknown :-1 s=CLOSED pgs=3948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.253 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.249+0000 7feab4c2fec0 1 --2- 172.21.15.57:0/4202184604 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x6d7aa0 0x7fb190 unknown :-1 s=CLOSED pgs=12930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.253 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.249+0000 7feab4c2fec0 1 -- 172.21.15.57:0/4202184604 >> 172.21.15.57:0/4202184604 conn(0x5f8960 msgr2=0x6d3c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:07:05.253 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.249+0000 7feab4c2fec0 1 -- 172.21.15.57:0/4202184604 shutdown_connections 2024-04-24T02:07:05.253 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.249+0000 7feab4c2fec0 1 -- 172.21.15.57:0/4202184604 wait complete. 2024-04-24T02:07:05.253 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in `seq 1 10` 2024-04-24T02:07:05.253 INFO:tasks.workunit.client.0.smithi057.stderr:+ rados -p 09b3c512-40ed-4aad-9a96-edbc8decb8dc put obj7 /etc/passwd 2024-04-24T02:07:05.290 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.288+0000 7f5462126ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:05.295 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.294+0000 7f5462126ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:05.295 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.294+0000 7f5462126ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:05.296 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.295+0000 7f5462126ec0 1 Processor -- start 2024-04-24T02:07:05.297 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.295+0000 7f5462126ec0 1 -- start start 2024-04-24T02:07:05.299 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.297+0000 7f5462126ec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x84c540 0x968800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.299 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.297+0000 7f5462126ec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7b1950 con 0x84c540 2024-04-24T02:07:05.299 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.297+0000 7f545a59b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x84c540 0x968800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:05.299 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.297+0000 7f545a59b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x84c540 0x968800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48356/0 (socket says 172.21.15.57:48356) 2024-04-24T02:07:05.299 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.297+0000 7f545a59b640 1 -- 172.21.15.57:0/1819767122 learned_addr learned my addr 172.21.15.57:0/1819767122 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:07:05.299 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.297+0000 7f545a59b640 1 -- 172.21.15.57:0/1819767122 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7501e0 con 0x84c540 2024-04-24T02:07:05.299 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.297+0000 7f545a59b640 1 --2- 172.21.15.57:0/1819767122 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x84c540 0x968800 crc :-1 s=READY pgs=12933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=715a9af9a1803523 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.299 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.297+0000 7f5458d98640 1 -- 172.21.15.57:0/1819767122 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f544400c490 con 0x84c540 2024-04-24T02:07:05.299 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.297+0000 7f5458d98640 1 -- 172.21.15.57:0/1819767122 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f544400c5f0 con 0x84c540 2024-04-24T02:07:05.299 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.297+0000 7f5458d98640 1 -- 172.21.15.57:0/1819767122 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f544400c890 con 0x84c540 2024-04-24T02:07:05.301 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.298+0000 7f5462126ec0 1 -- 172.21.15.57:0/1819767122 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x84c540 msgr2=0x968800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.301 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.298+0000 7f5462126ec0 1 --2- 172.21.15.57:0/1819767122 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x84c540 0x968800 crc :-1 s=READY pgs=12933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.301 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.298+0000 7f5462126ec0 1 -- 172.21.15.57:0/1819767122 shutdown_connections 2024-04-24T02:07:05.301 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.298+0000 7f5462126ec0 1 --2- 172.21.15.57:0/1819767122 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x84c540 0x968800 unknown :-1 s=CLOSED pgs=12933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.301 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.298+0000 7f5462126ec0 1 -- 172.21.15.57:0/1819767122 >> 172.21.15.57:0/1819767122 conn(0x768960 msgr2=0x8488b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:07:05.301 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.298+0000 7f5462126ec0 1 -- 172.21.15.57:0/1819767122 shutdown_connections 2024-04-24T02:07:05.301 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.298+0000 7f5462126ec0 1 -- 172.21.15.57:0/1819767122 wait complete. 2024-04-24T02:07:05.301 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.299+0000 7f5462126ec0 1 Processor -- start 2024-04-24T02:07:05.301 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.299+0000 7f5462126ec0 1 -- start start 2024-04-24T02:07:05.303 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.301+0000 7f5462126ec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x84c540 0x8c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.303 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.301+0000 7f5462126ec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7af3d0 con 0x84c540 2024-04-24T02:07:05.303 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.301+0000 7f545a59b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x84c540 0x8c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:05.303 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.301+0000 7f545a59b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x84c540 0x8c92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48372/0 (socket says 172.21.15.57:48372) 2024-04-24T02:07:05.303 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.301+0000 7f545a59b640 1 -- 172.21.15.57:0/10965923 learned_addr learned my addr 172.21.15.57:0/10965923 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:07:05.304 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.301+0000 7f545a59b640 1 -- 172.21.15.57:0/10965923 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x742e30 con 0x84c540 2024-04-24T02:07:05.304 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.301+0000 7f545a59b640 1 --2- 172.21.15.57:0/10965923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x84c540 0x8c92d0 crc :-1 s=READY pgs=12934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.304 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.301+0000 7f5452ffd640 1 -- 172.21.15.57:0/10965923 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5444016040 con 0x84c540 2024-04-24T02:07:05.304 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.301+0000 7f5452ffd640 1 -- 172.21.15.57:0/10965923 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5444011980 con 0x84c540 2024-04-24T02:07:05.304 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.301+0000 7f5462126ec0 1 -- 172.21.15.57:0/10965923 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x742890 con 0x84c540 2024-04-24T02:07:05.304 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.301+0000 7f5452ffd640 1 -- 172.21.15.57:0/10965923 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5444011c20 con 0x84c540 2024-04-24T02:07:05.304 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.302+0000 7f5462126ec0 1 -- 172.21.15.57:0/10965923 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x8ca720 con 0x84c540 2024-04-24T02:07:05.305 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.303+0000 7f5452ffd640 1 -- 172.21.15.57:0/10965923 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f544400e440 con 0x84c540 2024-04-24T02:07:05.305 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.303+0000 7f5452ffd640 1 --2- 172.21.15.57:0/10965923 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f5440037210 0x7f5440039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.305 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.303+0000 7f5452ffd640 1 -- 172.21.15.57:0/10965923 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(706..706 src has 395..706) ==== 4179+0+0 (crc 0 0 0) 0x7f5444049030 con 0x84c540 2024-04-24T02:07:05.305 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.303+0000 7f5462126ec0 1 --2- 172.21.15.57:0/10965923 >> v2:172.21.15.57:6805/2600611357 conn(0x84d060 0x975af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.305 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.303+0000 7f5462126ec0 1 -- 172.21.15.57:0/10965923 --> v2:172.21.15.57:6805/2600611357 -- osd_op(unknown.0.0:1 201.9 201:9a09113a:::obj7:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0x8cce90 con 0x84d060 2024-04-24T02:07:05.306 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.303+0000 7f5459d9a640 1 --2- 172.21.15.57:0/10965923 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f5440037210 0x7f5440039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:05.306 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.304+0000 7f5459d9a640 1 --2- 172.21.15.57:0/10965923 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f5440037210 0x7f5440039720 crc :-1 s=READY pgs=3949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.306 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.304+0000 7f545ad9c640 1 --2- 172.21.15.57:0/10965923 >> v2:172.21.15.57:6805/2600611357 conn(0x84d060 0x975af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T02:07:05.307 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.307+0000 7f545ad9c640 1 --2- 172.21.15.57:0/10965923 >> v2:172.21.15.57:6805/2600611357 conn(0x84d060 0x975af0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.320 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.317+0000 7f545ad9c640 1 -- 172.21.15.57:0/10965923 <== osd.1 v2:172.21.15.57:6805/2600611357 1 ==== osd_op_reply(1 obj7 [writefull 0~11876] v706'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f544c00a430 con 0x84d060 2024-04-24T02:07:05.320 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.317+0000 7f5462126ec0 1 -- 172.21.15.57:0/10965923 >> v2:172.21.15.57:6805/2600611357 conn(0x84d060 msgr2=0x975af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.320 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.317+0000 7f5462126ec0 1 --2- 172.21.15.57:0/10965923 >> v2:172.21.15.57:6805/2600611357 conn(0x84d060 0x975af0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.320 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.318+0000 7f5462126ec0 1 -- 172.21.15.57:0/10965923 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f5440037210 msgr2=0x7f5440039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.320 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.318+0000 7f5462126ec0 1 --2- 172.21.15.57:0/10965923 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f5440037210 0x7f5440039720 crc :-1 s=READY pgs=3949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.320 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.318+0000 7f5462126ec0 1 -- 172.21.15.57:0/10965923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x84c540 msgr2=0x8c92d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.320 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.318+0000 7f5462126ec0 1 --2- 172.21.15.57:0/10965923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x84c540 0x8c92d0 crc :-1 s=READY pgs=12934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.320 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.318+0000 7f5462126ec0 1 -- 172.21.15.57:0/10965923 shutdown_connections 2024-04-24T02:07:05.320 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.318+0000 7f5462126ec0 1 --2- 172.21.15.57:0/10965923 >> v2:172.21.15.57:6805/2600611357 conn(0x84d060 0x975af0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.320 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.318+0000 7f5462126ec0 1 --2- 172.21.15.57:0/10965923 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f5440037210 0x7f5440039720 unknown :-1 s=CLOSED pgs=3949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.320 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.318+0000 7f5462126ec0 1 --2- 172.21.15.57:0/10965923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x84c540 0x8c92d0 unknown :-1 s=CLOSED pgs=12934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.320 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.318+0000 7f5462126ec0 1 -- 172.21.15.57:0/10965923 >> 172.21.15.57:0/10965923 conn(0x768960 msgr2=0x8488b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:07:05.321 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.318+0000 7f5462126ec0 1 -- 172.21.15.57:0/10965923 shutdown_connections 2024-04-24T02:07:05.321 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.318+0000 7f5462126ec0 1 -- 172.21.15.57:0/10965923 wait complete. 2024-04-24T02:07:05.321 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in `seq 1 10` 2024-04-24T02:07:05.321 INFO:tasks.workunit.client.0.smithi057.stderr:+ rados -p 09b3c512-40ed-4aad-9a96-edbc8decb8dc put obj8 /etc/passwd 2024-04-24T02:07:05.358 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.356+0000 7f5d3065fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:05.363 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.362+0000 7f5d3065fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:05.363 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.362+0000 7f5d3065fec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:05.364 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.363+0000 7f5d3065fec0 1 Processor -- start 2024-04-24T02:07:05.364 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.363+0000 7f5d3065fec0 1 -- start start 2024-04-24T02:07:05.366 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.364+0000 7f5d3065fec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x220c660 0x220f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.366 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.364+0000 7f5d3065fec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x20df950 con 0x220c660 2024-04-24T02:07:05.366 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.365+0000 7f5d237fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x220c660 0x220f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:05.366 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.365+0000 7f5d237fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x220c660 0x220f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48390/0 (socket says 172.21.15.57:48390) 2024-04-24T02:07:05.366 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.365+0000 7f5d237fe640 1 -- 172.21.15.57:0/34017585 learned_addr learned my addr 172.21.15.57:0/34017585 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:07:05.367 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.365+0000 7f5d237fe640 1 -- 172.21.15.57:0/34017585 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x207e1e0 con 0x220c660 2024-04-24T02:07:05.367 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.365+0000 7f5d237fe640 1 --2- 172.21.15.57:0/34017585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x220c660 0x220f890 crc :-1 s=READY pgs=12937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ad779e6e5accbbc server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.367 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.365+0000 7f5d21ffb640 1 -- 172.21.15.57:0/34017585 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5d1400b5d0 con 0x220c660 2024-04-24T02:07:05.367 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.365+0000 7f5d21ffb640 1 -- 172.21.15.57:0/34017585 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5d1400b730 con 0x220c660 2024-04-24T02:07:05.367 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.365+0000 7f5d21ffb640 1 -- 172.21.15.57:0/34017585 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5d1400b9d0 con 0x220c660 2024-04-24T02:07:05.368 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.366+0000 7f5d3065fec0 1 -- 172.21.15.57:0/34017585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x220c660 msgr2=0x220f890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.368 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.366+0000 7f5d3065fec0 1 --2- 172.21.15.57:0/34017585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x220c660 0x220f890 crc :-1 s=READY pgs=12937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.368 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.366+0000 7f5d3065fec0 1 -- 172.21.15.57:0/34017585 shutdown_connections 2024-04-24T02:07:05.368 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.366+0000 7f5d3065fec0 1 --2- 172.21.15.57:0/34017585 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x220c660 0x220f890 unknown :-1 s=CLOSED pgs=12937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.368 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.366+0000 7f5d3065fec0 1 -- 172.21.15.57:0/34017585 >> 172.21.15.57:0/34017585 conn(0x2096960 msgr2=0x2171c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:07:05.368 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.366+0000 7f5d3065fec0 1 -- 172.21.15.57:0/34017585 shutdown_connections 2024-04-24T02:07:05.368 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.366+0000 7f5d3065fec0 1 -- 172.21.15.57:0/34017585 wait complete. 2024-04-24T02:07:05.368 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.367+0000 7f5d3065fec0 1 Processor -- start 2024-04-24T02:07:05.368 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.367+0000 7f5d3065fec0 1 -- start start 2024-04-24T02:07:05.370 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.368+0000 7f5d3065fec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x220c660 0x21f8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.371 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.368+0000 7f5d3065fec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x20dd3d0 con 0x220c660 2024-04-24T02:07:05.371 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.368+0000 7f5d237fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x220c660 0x21f8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:05.371 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.368+0000 7f5d237fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x220c660 0x21f8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48402/0 (socket says 172.21.15.57:48402) 2024-04-24T02:07:05.371 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.368+0000 7f5d237fe640 1 -- 172.21.15.57:0/3164905632 learned_addr learned my addr 172.21.15.57:0/3164905632 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:07:05.371 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.369+0000 7f5d237fe640 1 -- 172.21.15.57:0/3164905632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x2070e30 con 0x220c660 2024-04-24T02:07:05.371 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.369+0000 7f5d237fe640 1 --2- 172.21.15.57:0/3164905632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x220c660 0x21f8f00 crc :-1 s=READY pgs=12938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.371 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.369+0000 7f5d20ff9640 1 -- 172.21.15.57:0/3164905632 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5d14012910 con 0x220c660 2024-04-24T02:07:05.371 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.369+0000 7f5d20ff9640 1 -- 172.21.15.57:0/3164905632 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f5d14005040 con 0x220c660 2024-04-24T02:07:05.371 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.369+0000 7f5d3065fec0 1 -- 172.21.15.57:0/3164905632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x2070890 con 0x220c660 2024-04-24T02:07:05.371 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.369+0000 7f5d20ff9640 1 -- 172.21.15.57:0/3164905632 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f5d14012ba0 con 0x220c660 2024-04-24T02:07:05.371 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.369+0000 7f5d3065fec0 1 -- 172.21.15.57:0/3164905632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x21fa350 con 0x220c660 2024-04-24T02:07:05.372 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.370+0000 7f5d20ff9640 1 -- 172.21.15.57:0/3164905632 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f5d1400d040 con 0x220c660 2024-04-24T02:07:05.372 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.370+0000 7f5d20ff9640 1 --2- 172.21.15.57:0/3164905632 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f5d10037260 0x7f5d10039770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.373 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.370+0000 7f5d20ff9640 1 -- 172.21.15.57:0/3164905632 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(706..706 src has 395..706) ==== 4179+0+0 (crc 0 0 0) 0x7f5d1400a040 con 0x220c660 2024-04-24T02:07:05.373 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.370+0000 7f5d3065fec0 1 --2- 172.21.15.57:0/3164905632 >> v2:172.21.15.57:6805/2600611357 conn(0x220d180 0x22a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.373 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.370+0000 7f5d3065fec0 1 -- 172.21.15.57:0/3164905632 --> v2:172.21.15.57:6805/2600611357 -- osd_op(unknown.0.0:1 201.5 201:a557efb1:::obj8:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0x21fcac0 con 0x220d180 2024-04-24T02:07:05.373 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.371+0000 7f5d22ffd640 1 --2- 172.21.15.57:0/3164905632 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f5d10037260 0x7f5d10039770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:05.373 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.371+0000 7f5d22ffd640 1 --2- 172.21.15.57:0/3164905632 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f5d10037260 0x7f5d10039770 crc :-1 s=READY pgs=3950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.373 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.371+0000 7f5d28f9c640 1 --2- 172.21.15.57:0/3164905632 >> v2:172.21.15.57:6805/2600611357 conn(0x220d180 0x22a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T02:07:05.376 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.375+0000 7f5d28f9c640 1 --2- 172.21.15.57:0/3164905632 >> v2:172.21.15.57:6805/2600611357 conn(0x220d180 0x22a5bd0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.388 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.386+0000 7f5d28f9c640 1 -- 172.21.15.57:0/3164905632 <== osd.1 v2:172.21.15.57:6805/2600611357 1 ==== osd_op_reply(1 obj8 [writefull 0~11876] v706'1 uv1 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f5d1c00a430 con 0x220d180 2024-04-24T02:07:05.388 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.386+0000 7f5d3065fec0 1 -- 172.21.15.57:0/3164905632 >> v2:172.21.15.57:6805/2600611357 conn(0x220d180 msgr2=0x22a5bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.388 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.386+0000 7f5d3065fec0 1 --2- 172.21.15.57:0/3164905632 >> v2:172.21.15.57:6805/2600611357 conn(0x220d180 0x22a5bd0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.389 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.387+0000 7f5d3065fec0 1 -- 172.21.15.57:0/3164905632 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f5d10037260 msgr2=0x7f5d10039770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.389 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.387+0000 7f5d3065fec0 1 --2- 172.21.15.57:0/3164905632 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f5d10037260 0x7f5d10039770 crc :-1 s=READY pgs=3950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.389 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.387+0000 7f5d3065fec0 1 -- 172.21.15.57:0/3164905632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x220c660 msgr2=0x21f8f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.389 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.387+0000 7f5d3065fec0 1 --2- 172.21.15.57:0/3164905632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x220c660 0x21f8f00 crc :-1 s=READY pgs=12938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.389 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.387+0000 7f5d3065fec0 1 -- 172.21.15.57:0/3164905632 shutdown_connections 2024-04-24T02:07:05.389 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.387+0000 7f5d3065fec0 1 --2- 172.21.15.57:0/3164905632 >> v2:172.21.15.57:6805/2600611357 conn(0x220d180 0x22a5bd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.389 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.387+0000 7f5d3065fec0 1 --2- 172.21.15.57:0/3164905632 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f5d10037260 0x7f5d10039770 unknown :-1 s=CLOSED pgs=3950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.389 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.387+0000 7f5d3065fec0 1 --2- 172.21.15.57:0/3164905632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x220c660 0x21f8f00 unknown :-1 s=CLOSED pgs=12938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.389 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.387+0000 7f5d3065fec0 1 -- 172.21.15.57:0/3164905632 >> 172.21.15.57:0/3164905632 conn(0x2096960 msgr2=0x2171c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:07:05.389 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.387+0000 7f5d3065fec0 1 -- 172.21.15.57:0/3164905632 shutdown_connections 2024-04-24T02:07:05.389 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.387+0000 7f5d3065fec0 1 -- 172.21.15.57:0/3164905632 wait complete. 2024-04-24T02:07:05.390 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in `seq 1 10` 2024-04-24T02:07:05.390 INFO:tasks.workunit.client.0.smithi057.stderr:+ rados -p 09b3c512-40ed-4aad-9a96-edbc8decb8dc put obj9 /etc/passwd 2024-04-24T02:07:05.429 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.427+0000 7f148ae57ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:05.434 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.433+0000 7f148ae57ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:05.434 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.433+0000 7f148ae57ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:05.435 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.434+0000 7f148ae57ec0 1 Processor -- start 2024-04-24T02:07:05.435 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.434+0000 7f148ae57ec0 1 -- start start 2024-04-24T02:07:05.438 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.436+0000 7f148ae57ec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xc88be0 0xda0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.438 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.436+0000 7f148ae57ec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0xbef950 con 0xc88be0 2024-04-24T02:07:05.438 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.436+0000 7f1482f9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xc88be0 0xda0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:05.438 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.436+0000 7f1482f9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xc88be0 0xda0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48408/0 (socket says 172.21.15.57:48408) 2024-04-24T02:07:05.438 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.436+0000 7f1482f9b640 1 -- 172.21.15.57:0/3124827560 learned_addr learned my addr 172.21.15.57:0/3124827560 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:07:05.438 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.436+0000 7f1482f9b640 1 -- 172.21.15.57:0/3124827560 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xb8e1e0 con 0xc88be0 2024-04-24T02:07:05.438 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.436+0000 7f1482f9b640 1 --2- 172.21.15.57:0/3124827560 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xc88be0 0xda0530 crc :-1 s=READY pgs=12941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97932ee0218a93c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.438 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.436+0000 7f1481798640 1 -- 172.21.15.57:0/3124827560 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f146c009590 con 0xc88be0 2024-04-24T02:07:05.438 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.436+0000 7f1481798640 1 -- 172.21.15.57:0/3124827560 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f146c0096f0 con 0xc88be0 2024-04-24T02:07:05.438 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.436+0000 7f1481798640 1 -- 172.21.15.57:0/3124827560 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f146c009990 con 0xc88be0 2024-04-24T02:07:05.439 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.437+0000 7f148ae57ec0 1 -- 172.21.15.57:0/3124827560 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xc88be0 msgr2=0xda0530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.439 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.437+0000 7f148ae57ec0 1 --2- 172.21.15.57:0/3124827560 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xc88be0 0xda0530 crc :-1 s=READY pgs=12941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.440 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.437+0000 7f148ae57ec0 1 -- 172.21.15.57:0/3124827560 shutdown_connections 2024-04-24T02:07:05.440 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.437+0000 7f148ae57ec0 1 --2- 172.21.15.57:0/3124827560 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xc88be0 0xda0530 unknown :-1 s=CLOSED pgs=12941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.440 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.437+0000 7f148ae57ec0 1 -- 172.21.15.57:0/3124827560 >> 172.21.15.57:0/3124827560 conn(0xba6960 msgr2=0xda4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:07:05.440 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.437+0000 7f148ae57ec0 1 -- 172.21.15.57:0/3124827560 shutdown_connections 2024-04-24T02:07:05.440 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.437+0000 7f148ae57ec0 1 -- 172.21.15.57:0/3124827560 wait complete. 2024-04-24T02:07:05.440 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.438+0000 7f148ae57ec0 1 Processor -- start 2024-04-24T02:07:05.440 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.438+0000 7f148ae57ec0 1 -- start start 2024-04-24T02:07:05.441 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.440+0000 7f148ae57ec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xc88be0 0xd90710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.442 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.440+0000 7f148ae57ec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0xbed3d0 con 0xc88be0 2024-04-24T02:07:05.442 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.440+0000 7f1482f9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xc88be0 0xd90710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:05.442 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.440+0000 7f1482f9b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xc88be0 0xd90710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48422/0 (socket says 172.21.15.57:48422) 2024-04-24T02:07:05.442 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.440+0000 7f1482f9b640 1 -- 172.21.15.57:0/3868130879 learned_addr learned my addr 172.21.15.57:0/3868130879 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:07:05.442 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.440+0000 7f1482f9b640 1 -- 172.21.15.57:0/3868130879 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xb80e30 con 0xc88be0 2024-04-24T02:07:05.442 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.440+0000 7f1482f9b640 1 --2- 172.21.15.57:0/3868130879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xc88be0 0xd90710 crc :-1 s=READY pgs=12942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.442 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.440+0000 7f147b7fe640 1 -- 172.21.15.57:0/3868130879 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f146c010040 con 0xc88be0 2024-04-24T02:07:05.442 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.440+0000 7f147b7fe640 1 -- 172.21.15.57:0/3868130879 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f146c0089a0 con 0xc88be0 2024-04-24T02:07:05.442 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.440+0000 7f148ae57ec0 1 -- 172.21.15.57:0/3868130879 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xb80890 con 0xc88be0 2024-04-24T02:07:05.442 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.440+0000 7f147b7fe640 1 -- 172.21.15.57:0/3868130879 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f146c008c40 con 0xc88be0 2024-04-24T02:07:05.442 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.440+0000 7f148ae57ec0 1 -- 172.21.15.57:0/3868130879 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0xc82720 con 0xc88be0 2024-04-24T02:07:05.443 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.441+0000 7f147b7fe640 1 -- 172.21.15.57:0/3868130879 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f146c014300 con 0xc88be0 2024-04-24T02:07:05.443 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.441+0000 7f147b7fe640 1 --2- 172.21.15.57:0/3868130879 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f1468037210 0x7f1468039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.443 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.441+0000 7f147b7fe640 1 -- 172.21.15.57:0/3868130879 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(706..706 src has 395..706) ==== 4179+0+0 (crc 0 0 0) 0x7f146c048090 con 0xc88be0 2024-04-24T02:07:05.444 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.442+0000 7f148ae57ec0 1 --2- 172.21.15.57:0/3868130879 >> v2:172.21.15.84:6808/91137974 conn(0xc8ac50 0xdb3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.444 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.442+0000 7f148ae57ec0 1 -- 172.21.15.57:0/3868130879 --> v2:172.21.15.84:6808/91137974 -- osd_op(unknown.0.0:1 201.7 201:fe351e27:::obj9:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0xd939d0 con 0xc8ac50 2024-04-24T02:07:05.444 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.442+0000 7f148279a640 1 --2- 172.21.15.57:0/3868130879 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f1468037210 0x7f1468039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:05.444 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.442+0000 7f148279a640 1 --2- 172.21.15.57:0/3868130879 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f1468037210 0x7f1468039720 crc :-1 s=READY pgs=3951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.444 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.443+0000 7f148379c640 1 --2- 172.21.15.57:0/3868130879 >> v2:172.21.15.84:6808/91137974 conn(0xc8ac50 0xdb3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T02:07:05.449 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.448+0000 7f148379c640 1 --2- 172.21.15.57:0/3868130879 >> v2:172.21.15.84:6808/91137974 conn(0xc8ac50 0xdb3cf0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.462 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.460+0000 7f148379c640 1 -- 172.21.15.57:0/3868130879 <== osd.3 v2:172.21.15.84:6808/91137974 1 ==== osd_op_reply(1 obj9 [writefull 0~11876] v706'2 uv2 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f147400a430 con 0xc8ac50 2024-04-24T02:07:05.462 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.460+0000 7f148ae57ec0 1 -- 172.21.15.57:0/3868130879 >> v2:172.21.15.84:6808/91137974 conn(0xc8ac50 msgr2=0xdb3cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.462 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.460+0000 7f148ae57ec0 1 --2- 172.21.15.57:0/3868130879 >> v2:172.21.15.84:6808/91137974 conn(0xc8ac50 0xdb3cf0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.463 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.460+0000 7f148ae57ec0 1 -- 172.21.15.57:0/3868130879 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f1468037210 msgr2=0x7f1468039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.463 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.460+0000 7f148ae57ec0 1 --2- 172.21.15.57:0/3868130879 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f1468037210 0x7f1468039720 crc :-1 s=READY pgs=3951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.463 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.460+0000 7f148ae57ec0 1 -- 172.21.15.57:0/3868130879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xc88be0 msgr2=0xd90710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.463 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.460+0000 7f148ae57ec0 1 --2- 172.21.15.57:0/3868130879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xc88be0 0xd90710 crc :-1 s=READY pgs=12942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.463 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.460+0000 7f148ae57ec0 1 -- 172.21.15.57:0/3868130879 shutdown_connections 2024-04-24T02:07:05.463 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.460+0000 7f148ae57ec0 1 --2- 172.21.15.57:0/3868130879 >> v2:172.21.15.84:6808/91137974 conn(0xc8ac50 0xdb3cf0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.463 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.460+0000 7f148ae57ec0 1 --2- 172.21.15.57:0/3868130879 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f1468037210 0x7f1468039720 unknown :-1 s=CLOSED pgs=3951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.463 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.460+0000 7f148ae57ec0 1 --2- 172.21.15.57:0/3868130879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xc88be0 0xd90710 unknown :-1 s=CLOSED pgs=12942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.463 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.460+0000 7f148ae57ec0 1 -- 172.21.15.57:0/3868130879 >> 172.21.15.57:0/3868130879 conn(0xba6960 msgr2=0xda4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:07:05.463 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.460+0000 7f148ae57ec0 1 -- 172.21.15.57:0/3868130879 shutdown_connections 2024-04-24T02:07:05.463 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.461+0000 7f148ae57ec0 1 -- 172.21.15.57:0/3868130879 wait complete. 2024-04-24T02:07:05.464 INFO:tasks.workunit.client.0.smithi057.stderr:+ for f in `seq 1 10` 2024-04-24T02:07:05.464 INFO:tasks.workunit.client.0.smithi057.stderr:+ rados -p 09b3c512-40ed-4aad-9a96-edbc8decb8dc put obj10 /etc/passwd 2024-04-24T02:07:05.501 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.499+0000 7f7fd9837ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:05.506 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.505+0000 7f7fd9837ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:05.506 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.505+0000 7f7fd9837ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:05.507 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.506+0000 7f7fd9837ec0 1 Processor -- start 2024-04-24T02:07:05.507 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.506+0000 7f7fd9837ec0 1 -- start start 2024-04-24T02:07:05.510 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.508+0000 7f7fd9837ec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1e98ab0 0x1e9a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.510 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.508+0000 7f7fd9837ec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x1d6b950 con 0x1e98ab0 2024-04-24T02:07:05.510 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.508+0000 7f7fd199b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1e98ab0 0x1e9a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:05.510 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.508+0000 7f7fd199b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1e98ab0 0x1e9a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48436/0 (socket says 172.21.15.57:48436) 2024-04-24T02:07:05.510 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.508+0000 7f7fd199b640 1 -- 172.21.15.57:0/2948935756 learned_addr learned my addr 172.21.15.57:0/2948935756 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:07:05.510 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.508+0000 7f7fd199b640 1 -- 172.21.15.57:0/2948935756 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1d0a1e0 con 0x1e98ab0 2024-04-24T02:07:05.510 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.508+0000 7f7fd199b640 1 --2- 172.21.15.57:0/2948935756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1e98ab0 0x1e9a970 crc :-1 s=READY pgs=12945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4dce91fd32a908e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.510 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.508+0000 7f7fcb7fe640 1 -- 172.21.15.57:0/2948935756 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7fbc00b500 con 0x1e98ab0 2024-04-24T02:07:05.510 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.508+0000 7f7fcb7fe640 1 -- 172.21.15.57:0/2948935756 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7fbc00b660 con 0x1e98ab0 2024-04-24T02:07:05.510 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.508+0000 7f7fcb7fe640 1 -- 172.21.15.57:0/2948935756 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7fbc00b900 con 0x1e98ab0 2024-04-24T02:07:05.511 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.509+0000 7f7fd9837ec0 1 -- 172.21.15.57:0/2948935756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1e98ab0 msgr2=0x1e9a970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.511 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.509+0000 7f7fd9837ec0 1 --2- 172.21.15.57:0/2948935756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1e98ab0 0x1e9a970 crc :-1 s=READY pgs=12945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.511 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.509+0000 7f7fd9837ec0 1 -- 172.21.15.57:0/2948935756 shutdown_connections 2024-04-24T02:07:05.512 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.509+0000 7f7fd9837ec0 1 --2- 172.21.15.57:0/2948935756 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1e98ab0 0x1e9a970 unknown :-1 s=CLOSED pgs=12945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.512 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.509+0000 7f7fd9837ec0 1 -- 172.21.15.57:0/2948935756 >> 172.21.15.57:0/2948935756 conn(0x1d22960 msgr2=0x1e964e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:07:05.512 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.509+0000 7f7fd9837ec0 1 -- 172.21.15.57:0/2948935756 shutdown_connections 2024-04-24T02:07:05.512 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.509+0000 7f7fd9837ec0 1 -- 172.21.15.57:0/2948935756 wait complete. 2024-04-24T02:07:05.512 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.510+0000 7f7fd9837ec0 1 Processor -- start 2024-04-24T02:07:05.512 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.510+0000 7f7fd9837ec0 1 -- start start 2024-04-24T02:07:05.514 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.512+0000 7f7fd9837ec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1e98ab0 0x1e83290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.514 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.512+0000 7f7fd9837ec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x1d693d0 con 0x1e98ab0 2024-04-24T02:07:05.514 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.512+0000 7f7fd199b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1e98ab0 0x1e83290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:05.514 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.512+0000 7f7fd199b640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1e98ab0 0x1e83290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48446/0 (socket says 172.21.15.57:48446) 2024-04-24T02:07:05.514 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.512+0000 7f7fd199b640 1 -- 172.21.15.57:0/3721965719 learned_addr learned my addr 172.21.15.57:0/3721965719 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:07:05.514 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.512+0000 7f7fd199b640 1 -- 172.21.15.57:0/3721965719 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x1cfce30 con 0x1e98ab0 2024-04-24T02:07:05.514 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.512+0000 7f7fd199b640 1 --2- 172.21.15.57:0/3721965719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1e98ab0 0x1e83290 crc :-1 s=READY pgs=12946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.514 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.512+0000 7f7fca7fc640 1 -- 172.21.15.57:0/3721965719 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7fbc0111e0 con 0x1e98ab0 2024-04-24T02:07:05.514 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.512+0000 7f7fca7fc640 1 -- 172.21.15.57:0/3721965719 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7fbc0117a0 con 0x1e98ab0 2024-04-24T02:07:05.514 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.512+0000 7f7fd9837ec0 1 -- 172.21.15.57:0/3721965719 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x1cfc890 con 0x1e98ab0 2024-04-24T02:07:05.514 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.512+0000 7f7fca7fc640 1 -- 172.21.15.57:0/3721965719 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7fbc011910 con 0x1e98ab0 2024-04-24T02:07:05.514 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.512+0000 7f7fd9837ec0 1 -- 172.21.15.57:0/3721965719 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x1e86650 con 0x1e98ab0 2024-04-24T02:07:05.515 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.513+0000 7f7fca7fc640 1 -- 172.21.15.57:0/3721965719 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f7fbc011ac0 con 0x1e98ab0 2024-04-24T02:07:05.516 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.513+0000 7f7fca7fc640 1 --2- 172.21.15.57:0/3721965719 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f7fb8037210 0x7f7fb8039720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.516 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.514+0000 7f7fca7fc640 1 -- 172.21.15.57:0/3721965719 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(706..706 src has 395..706) ==== 4179+0+0 (crc 0 0 0) 0x7f7fbc048d60 con 0x1e98ab0 2024-04-24T02:07:05.516 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.514+0000 7f7fd9837ec0 1 --2- 172.21.15.57:0/3721965719 >> v2:172.21.15.57:6805/2600611357 conn(0x1e9b8f0 0x2331b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:05.516 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.514+0000 7f7fd9837ec0 1 -- 172.21.15.57:0/3721965719 --> v2:172.21.15.57:6805/2600611357 -- osd_op(unknown.0.0:1 201.b 201:d1337354:::obj10:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e706) -- 0x1e86d80 con 0x1e9b8f0 2024-04-24T02:07:05.516 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.514+0000 7f7fd119a640 1 --2- 172.21.15.57:0/3721965719 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f7fb8037210 0x7f7fb8039720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:05.516 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.515+0000 7f7fd119a640 1 --2- 172.21.15.57:0/3721965719 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f7fb8037210 0x7f7fb8039720 crc :-1 s=READY pgs=3952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.516 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.515+0000 7f7fd219c640 1 --2- 172.21.15.57:0/3721965719 >> v2:172.21.15.57:6805/2600611357 conn(0x1e9b8f0 0x2331b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T02:07:05.519 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.518+0000 7f7fd219c640 1 --2- 172.21.15.57:0/3721965719 >> v2:172.21.15.57:6805/2600611357 conn(0x1e9b8f0 0x2331b10 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:05.532 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.530+0000 7f7fd219c640 1 -- 172.21.15.57:0/3721965719 <== osd.1 v2:172.21.15.57:6805/2600611357 1 ==== osd_op_reply(1 obj10 [writefull 0~11876] v706'1 uv1 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f7fc400a430 con 0x1e9b8f0 2024-04-24T02:07:05.532 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.530+0000 7f7fd9837ec0 1 -- 172.21.15.57:0/3721965719 >> v2:172.21.15.57:6805/2600611357 conn(0x1e9b8f0 msgr2=0x2331b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.532 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.530+0000 7f7fd9837ec0 1 --2- 172.21.15.57:0/3721965719 >> v2:172.21.15.57:6805/2600611357 conn(0x1e9b8f0 0x2331b10 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.532 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.530+0000 7f7fd9837ec0 1 -- 172.21.15.57:0/3721965719 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f7fb8037210 msgr2=0x7f7fb8039720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.532 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.530+0000 7f7fd9837ec0 1 --2- 172.21.15.57:0/3721965719 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f7fb8037210 0x7f7fb8039720 crc :-1 s=READY pgs=3952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.532 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.530+0000 7f7fd9837ec0 1 -- 172.21.15.57:0/3721965719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1e98ab0 msgr2=0x1e83290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:05.532 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.530+0000 7f7fd9837ec0 1 --2- 172.21.15.57:0/3721965719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1e98ab0 0x1e83290 crc :-1 s=READY pgs=12946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.532 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.530+0000 7f7fd9837ec0 1 -- 172.21.15.57:0/3721965719 shutdown_connections 2024-04-24T02:07:05.533 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.530+0000 7f7fd9837ec0 1 --2- 172.21.15.57:0/3721965719 >> v2:172.21.15.57:6805/2600611357 conn(0x1e9b8f0 0x2331b10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.533 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.530+0000 7f7fd9837ec0 1 --2- 172.21.15.57:0/3721965719 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f7fb8037210 0x7f7fb8039720 unknown :-1 s=CLOSED pgs=3952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.533 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.530+0000 7f7fd9837ec0 1 --2- 172.21.15.57:0/3721965719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x1e98ab0 0x1e83290 unknown :-1 s=CLOSED pgs=12946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:05.533 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.530+0000 7f7fd9837ec0 1 -- 172.21.15.57:0/3721965719 >> 172.21.15.57:0/3721965719 conn(0x1d22960 msgr2=0x1e964e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:07:05.533 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.530+0000 7f7fd9837ec0 1 -- 172.21.15.57:0/3721965719 shutdown_connections 2024-04-24T02:07:05.533 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:05.531+0000 7f7fd9837ec0 1 -- 172.21.15.57:0/3721965719 wait complete. 2024-04-24T02:07:05.534 INFO:tasks.workunit.client.0.smithi057.stderr:+ sleep 30 2024-04-24T02:07:35.535 INFO:tasks.workunit.client.0.smithi057.stderr:+ rados -p 319496fe-d53f-40fe-a120-83451e8717ac put threemore /etc/passwd 2024-04-24T02:07:35.578 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.578+0000 7f0b2b8d8ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:35.584 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.584+0000 7f0b2b8d8ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:35.584 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.584+0000 7f0b2b8d8ec0 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:35.585 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.585+0000 7f0b2b8d8ec0 1 Processor -- start 2024-04-24T02:07:35.585 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.585+0000 7f0b2b8d8ec0 1 -- start start 2024-04-24T02:07:35.587 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.586+0000 7f0b2b8d8ec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xdf5840 0xf30ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:35.587 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.586+0000 7f0b2b8d8ec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0xd75950 con 0xdf5840 2024-04-24T02:07:35.587 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.586+0000 7f0b1effd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xdf5840 0xf30ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:35.588 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.586+0000 7f0b1effd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xdf5840 0xf30ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50390/0 (socket says 172.21.15.57:50390) 2024-04-24T02:07:35.588 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.586+0000 7f0b1effd640 1 -- 172.21.15.57:0/4273065979 learned_addr learned my addr 172.21.15.57:0/4273065979 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:07:35.588 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.587+0000 7f0b1effd640 1 -- 172.21.15.57:0/4273065979 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xd141e0 con 0xdf5840 2024-04-24T02:07:35.588 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.587+0000 7f0b1effd640 1 --2- 172.21.15.57:0/4273065979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xdf5840 0xf30ae0 crc :-1 s=READY pgs=12949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc76b277b7a5cd32 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:35.588 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.587+0000 7f0b1d7fa640 1 -- 172.21.15.57:0/4273065979 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0b10006b90 con 0xdf5840 2024-04-24T02:07:35.588 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.587+0000 7f0b1d7fa640 1 -- 172.21.15.57:0/4273065979 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0b10006cf0 con 0xdf5840 2024-04-24T02:07:35.588 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.587+0000 7f0b1d7fa640 1 -- 172.21.15.57:0/4273065979 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0b10034410 con 0xdf5840 2024-04-24T02:07:35.589 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.588+0000 7f0b2b8d8ec0 1 -- 172.21.15.57:0/4273065979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xdf5840 msgr2=0xf30ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:35.589 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.588+0000 7f0b2b8d8ec0 1 --2- 172.21.15.57:0/4273065979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xdf5840 0xf30ae0 crc :-1 s=READY pgs=12949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:35.589 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.588+0000 7f0b2b8d8ec0 1 -- 172.21.15.57:0/4273065979 shutdown_connections 2024-04-24T02:07:35.589 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.588+0000 7f0b2b8d8ec0 1 --2- 172.21.15.57:0/4273065979 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xdf5840 0xf30ae0 unknown :-1 s=CLOSED pgs=12949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:35.589 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.588+0000 7f0b2b8d8ec0 1 -- 172.21.15.57:0/4273065979 >> 172.21.15.57:0/4273065979 conn(0xd2c960 msgr2=0xea5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:07:35.590 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.588+0000 7f0b2b8d8ec0 1 -- 172.21.15.57:0/4273065979 shutdown_connections 2024-04-24T02:07:35.590 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.588+0000 7f0b2b8d8ec0 1 -- 172.21.15.57:0/4273065979 wait complete. 2024-04-24T02:07:35.590 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.589+0000 7f0b2b8d8ec0 1 Processor -- start 2024-04-24T02:07:35.590 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.589+0000 7f0b2b8d8ec0 1 -- start start 2024-04-24T02:07:35.592 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.590+0000 7f0b2b8d8ec0 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xdf5840 0xe8e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:35.592 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.590+0000 7f0b2b8d8ec0 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0xd733d0 con 0xdf5840 2024-04-24T02:07:35.592 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.591+0000 7f0b1effd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xdf5840 0xe8e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:35.592 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.591+0000 7f0b1effd640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xdf5840 0xe8e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50396/0 (socket says 172.21.15.57:50396) 2024-04-24T02:07:35.592 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.591+0000 7f0b1effd640 1 -- 172.21.15.57:0/2820622244 learned_addr learned my addr 172.21.15.57:0/2820622244 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:07:35.592 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.591+0000 7f0b1effd640 1 -- 172.21.15.57:0/2820622244 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0xd06e30 con 0xdf5840 2024-04-24T02:07:35.592 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.591+0000 7f0b1effd640 1 --2- 172.21.15.57:0/2820622244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xdf5840 0xe8e560 crc :-1 s=READY pgs=12950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:35.592 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.591+0000 7f0b07fff640 1 -- 172.21.15.57:0/2820622244 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0b10039040 con 0xdf5840 2024-04-24T02:07:35.593 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.591+0000 7f0b07fff640 1 -- 172.21.15.57:0/2820622244 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0b10034b40 con 0xdf5840 2024-04-24T02:07:35.593 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.591+0000 7f0b2b8d8ec0 1 -- 172.21.15.57:0/2820622244 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0xd06890 con 0xdf5840 2024-04-24T02:07:35.593 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.591+0000 7f0b07fff640 1 -- 172.21.15.57:0/2820622244 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0b10034de0 con 0xdf5840 2024-04-24T02:07:35.593 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.591+0000 7f0b2b8d8ec0 1 -- 172.21.15.57:0/2820622244 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0xe8e010 con 0xdf5840 2024-04-24T02:07:35.594 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.592+0000 7f0b07fff640 1 -- 172.21.15.57:0/2820622244 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f0b1003c040 con 0xdf5840 2024-04-24T02:07:35.594 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.592+0000 7f0b07fff640 1 --2- 172.21.15.57:0/2820622244 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f0b0c037260 0x7f0b0c039770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:35.594 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.593+0000 7f0b07fff640 1 -- 172.21.15.57:0/2820622244 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(708..708 src has 395..708) ==== 4179+0+0 (crc 0 0 0) 0x7f0b100695c0 con 0xdf5840 2024-04-24T02:07:35.594 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.593+0000 7f0b07fff640 1 -- 172.21.15.57:0/2820622244 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=709}) -- 0x7f0b0c03dcf0 con 0xdf5840 2024-04-24T02:07:35.594 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.593+0000 7f0b2b8d8ec0 1 --2- 172.21.15.57:0/2820622244 >> v2:172.21.15.84:6805/1003835807 conn(0xe0edd0 0xf39c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:35.594 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.593+0000 7f0b2b8d8ec0 1 -- 172.21.15.57:0/2820622244 --> v2:172.21.15.84:6805/1003835807 -- osd_op(unknown.0.0:1 200.2 200:47cad802:::threemore:head [writefull 0~11876 in=11876b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e708) -- 0xea12c0 con 0xe0edd0 2024-04-24T02:07:35.594 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.593+0000 7f0b1e7fc640 1 --2- 172.21.15.57:0/2820622244 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f0b0c037260 0x7f0b0c039770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:35.594 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.594+0000 7f0b1e7fc640 1 --2- 172.21.15.57:0/2820622244 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f0b0c037260 0x7f0b0c039770 crc :-1 s=READY pgs=3953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:35.595 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.594+0000 7f0b1f7fe640 1 --2- 172.21.15.57:0/2820622244 >> v2:172.21.15.84:6805/1003835807 conn(0xe0edd0 0xf39c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T02:07:35.599 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.599+0000 7f0b1f7fe640 1 --2- 172.21.15.57:0/2820622244 >> v2:172.21.15.84:6805/1003835807 conn(0xe0edd0 0xf39c50 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:35.613 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.611+0000 7f0b1f7fe640 1 -- 172.21.15.57:0/2820622244 <== osd.2 v2:172.21.15.84:6805/1003835807 1 ==== osd_op_reply(1 threemore [writefull 0~11876] v708'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f0b1800a430 con 0xe0edd0 2024-04-24T02:07:35.613 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.611+0000 7f0b2b8d8ec0 1 -- 172.21.15.57:0/2820622244 >> v2:172.21.15.84:6805/1003835807 conn(0xe0edd0 msgr2=0xf39c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:35.613 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.611+0000 7f0b2b8d8ec0 1 --2- 172.21.15.57:0/2820622244 >> v2:172.21.15.84:6805/1003835807 conn(0xe0edd0 0xf39c50 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:35.613 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.611+0000 7f0b2b8d8ec0 1 -- 172.21.15.57:0/2820622244 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f0b0c037260 msgr2=0x7f0b0c039770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:35.613 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.611+0000 7f0b2b8d8ec0 1 --2- 172.21.15.57:0/2820622244 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f0b0c037260 0x7f0b0c039770 crc :-1 s=READY pgs=3953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:35.613 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.611+0000 7f0b2b8d8ec0 1 -- 172.21.15.57:0/2820622244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xdf5840 msgr2=0xe8e560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:35.613 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.611+0000 7f0b2b8d8ec0 1 --2- 172.21.15.57:0/2820622244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xdf5840 0xe8e560 crc :-1 s=READY pgs=12950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:35.613 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.612+0000 7f0b2b8d8ec0 1 -- 172.21.15.57:0/2820622244 shutdown_connections 2024-04-24T02:07:35.613 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.612+0000 7f0b2b8d8ec0 1 --2- 172.21.15.57:0/2820622244 >> v2:172.21.15.84:6805/1003835807 conn(0xe0edd0 0xf39c50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:35.613 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.612+0000 7f0b2b8d8ec0 1 --2- 172.21.15.57:0/2820622244 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f0b0c037260 0x7f0b0c039770 unknown :-1 s=CLOSED pgs=3953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:35.614 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.612+0000 7f0b2b8d8ec0 1 --2- 172.21.15.57:0/2820622244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0xdf5840 0xe8e560 unknown :-1 s=CLOSED pgs=12950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:35.614 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.612+0000 7f0b2b8d8ec0 1 -- 172.21.15.57:0/2820622244 >> 172.21.15.57:0/2820622244 conn(0xd2c960 msgr2=0xea5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:07:35.614 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.612+0000 7f0b2b8d8ec0 1 -- 172.21.15.57:0/2820622244 shutdown_connections 2024-04-24T02:07:35.614 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.612+0000 7f0b2b8d8ec0 1 -- 172.21.15.57:0/2820622244 wait complete. 2024-04-24T02:07:35.614 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph osd pool set-quota 319496fe-d53f-40fe-a120-83451e8717ac max_bytes 0 2024-04-24T02:07:35.714 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.705+0000 7f57ef26d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:35.715 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.715+0000 7f57ef26d640 1 Processor -- start 2024-04-24T02:07:35.715 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.715+0000 7f57ef26d640 1 -- start start 2024-04-24T02:07:35.719 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.716+0000 7f57ef26d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f57e8073230 0x7f57e8071d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:35.719 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.716+0000 7f57ef26d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57e8073640 con 0x7f57e8132a90 2024-04-24T02:07:35.719 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.716+0000 7f57ef26d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f57e8072fb0 con 0x7f57e8073230 2024-04-24T02:07:35.719 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.716+0000 7f57ed009640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f57e8132a90 0x7f57e812f550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40660/0 (socket says 172.21.15.57:40660) 2024-04-24T02:07:35.719 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.716+0000 7f57ed009640 1 -- 172.21.15.57:0/462460933 learned_addr learned my addr 172.21.15.57:0/462460933 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T02:07:35.719 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.716+0000 7f57ec808640 1 --2- 172.21.15.57:0/462460933 >> v2:172.21.15.57:3300/0 conn(0x7f57e8073230 0x7f57e8071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:35.720 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.717+0000 7f57e7fff640 1 -- 172.21.15.57:0/462460933 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3719269019 0 0) 0x7f57e8073640 con 0x7f57e8132a90 2024-04-24T02:07:35.720 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.717+0000 7f57e7fff640 1 -- 172.21.15.57:0/462460933 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57d0003580 con 0x7f57e8132a90 2024-04-24T02:07:35.720 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.717+0000 7f57ec808640 1 -- 172.21.15.57:0/462460933 >> v1:172.21.15.57:6789/0 conn(0x7f57e8132a90 legacy=0x7f57e812f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:35.720 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.717+0000 7f57ec808640 1 -- 172.21.15.57:0/462460933 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e8133320 con 0x7f57e8073230 2024-04-24T02:07:35.720 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.717+0000 7f57ec808640 1 --2- 172.21.15.57:0/462460933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57e8073230 0x7f57e8071d90 crc :-1 s=READY pgs=12952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9271079c2d3b4e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:35.720 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.717+0000 7f57e7fff640 1 -- 172.21.15.57:0/462460933 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f57dc009d90 con 0x7f57e8073230 2024-04-24T02:07:35.720 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.717+0000 7f57e7fff640 1 -- 172.21.15.57:0/462460933 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f57dc00e230 con 0x7f57e8073230 2024-04-24T02:07:35.720 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.717+0000 7f57e7fff640 1 -- 172.21.15.57:0/462460933 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f57dc00e4d0 con 0x7f57e8073230 2024-04-24T02:07:35.720 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.718+0000 7f57ef26d640 1 -- 172.21.15.57:0/462460933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57e8073230 msgr2=0x7f57e8071d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:35.720 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.718+0000 7f57ef26d640 1 --2- 172.21.15.57:0/462460933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57e8073230 0x7f57e8071d90 crc :-1 s=READY pgs=12952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:35.720 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.718+0000 7f57ef26d640 1 -- 172.21.15.57:0/462460933 shutdown_connections 2024-04-24T02:07:35.720 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.718+0000 7f57ef26d640 1 --2- 172.21.15.57:0/462460933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57e8073230 0x7f57e8071d90 unknown :-1 s=CLOSED pgs=12952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:35.721 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.718+0000 7f57ef26d640 1 -- 172.21.15.57:0/462460933 >> 172.21.15.57:0/462460933 conn(0x7f57e80a0bd0 msgr2=0x7f57e80a0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:07:35.721 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.718+0000 7f57ef26d640 1 -- 172.21.15.57:0/462460933 shutdown_connections 2024-04-24T02:07:35.721 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.718+0000 7f57ef26d640 1 -- 172.21.15.57:0/462460933 wait complete. 2024-04-24T02:07:35.721 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.718+0000 7f57ef26d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:35.723 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.720+0000 7f57ef26d640 1 Processor -- start 2024-04-24T02:07:35.723 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.720+0000 7f57ef26d640 1 -- start start 2024-04-24T02:07:35.723 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.721+0000 7f57ef26d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57e8073230 0x7f57e8129ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:35.723 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.721+0000 7f57ef26d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f57e812b960 con 0x7f57e8073230 2024-04-24T02:07:35.723 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.722+0000 7f57ed009640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57e8073230 0x7f57e8129ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:35.723 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.722+0000 7f57ed009640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57e8073230 0x7f57e8129ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50426/0 (socket says 172.21.15.57:50426) 2024-04-24T02:07:35.723 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.722+0000 7f57ed009640 1 -- 172.21.15.57:0/1034298521 learned_addr learned my addr 172.21.15.57:0/1034298521 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:07:35.723 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.722+0000 7f57ed009640 1 -- 172.21.15.57:0/1034298521 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e812c780 con 0x7f57e8073230 2024-04-24T02:07:35.723 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.722+0000 7f57ed009640 1 --2- 172.21.15.57:0/1034298521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57e8073230 0x7f57e8129ba0 crc :-1 s=READY pgs=12953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:35.724 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.722+0000 7f57e5ffb640 1 -- 172.21.15.57:0/1034298521 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f57e0005a60 con 0x7f57e8073230 2024-04-24T02:07:35.724 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.722+0000 7f57e5ffb640 1 -- 172.21.15.57:0/1034298521 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f57e0005bc0 con 0x7f57e8073230 2024-04-24T02:07:35.724 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.722+0000 7f57ef26d640 1 -- 172.21.15.57:0/1034298521 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57e808c200 con 0x7f57e8073230 2024-04-24T02:07:35.724 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.722+0000 7f57e5ffb640 1 -- 172.21.15.57:0/1034298521 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f57e0005e60 con 0x7f57e8073230 2024-04-24T02:07:35.724 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.722+0000 7f57ef26d640 1 -- 172.21.15.57:0/1034298521 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57e812c4e0 con 0x7f57e8073230 2024-04-24T02:07:35.725 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.723+0000 7f57e5ffb640 1 -- 172.21.15.57:0/1034298521 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f57e000c840 con 0x7f57e8073230 2024-04-24T02:07:35.725 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.723+0000 7f57e5ffb640 1 --2- 172.21.15.57:0/1034298521 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f57d4038980 0x7f57d403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:35.725 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.723+0000 7f57ef26d640 1 -- 172.21.15.57:0/1034298521 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57e8073920 con 0x7f57e8073230 2024-04-24T02:07:35.725 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.723+0000 7f57e5ffb640 1 -- 172.21.15.57:0/1034298521 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(708..708 src has 395..708) ==== 4179+0+0 (crc 0 0 0) 0x7f57e00487e0 con 0x7f57e8073230 2024-04-24T02:07:35.725 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.724+0000 7f57e5ffb640 1 -- 172.21.15.57:0/1034298521 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=709}) -- 0x7f57d403f330 con 0x7f57e8073230 2024-04-24T02:07:35.725 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.724+0000 7f57ec808640 1 --2- 172.21.15.57:0/1034298521 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f57d4038980 0x7f57d403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:35.725 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.724+0000 7f57ec808640 1 --2- 172.21.15.57:0/1034298521 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f57d4038980 0x7f57d403ae90 crc :-1 s=READY pgs=3954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:35.729 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.729+0000 7f57e5ffb640 1 -- 172.21.15.57:0/1034298521 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f57e000d740 con 0x7f57e8073230 2024-04-24T02:07:35.921 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:35.921+0000 7f57ef26d640 1 -- 172.21.15.57:0/1034298521 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "field": "max_bytes", "val": "0"} v 0) -- 0x7f57e808cc30 con 0x7f57e8073230 2024-04-24T02:07:36.742 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:36.742+0000 7f57e5ffb640 1 -- 172.21.15.57:0/1034298521 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 319496fe-d53f-40fe-a120-83451e8717ac v709) ==== 217+0+0 (crc 0 0 0) 0x7f57e000d150 con 0x7f57e8073230 2024-04-24T02:07:36.744 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:36.744+0000 7f57e5ffb640 1 -- 172.21.15.57:0/1034298521 <== mon.0 v2:172.21.15.57:3300/0 8 ==== osd_map(709..709 src has 395..709) ==== 628+0+0 (crc 0 0 0) 0x7f57e000adc0 con 0x7f57e8073230 2024-04-24T02:07:36.744 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:36.744+0000 7f57e5ffb640 1 -- 172.21.15.57:0/1034298521 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=710}) -- 0x7f57d403fd60 con 0x7f57e8073230 2024-04-24T02:07:36.933 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:36.933+0000 7f57ef26d640 1 -- 172.21.15.57:0/1034298521 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "field": "max_bytes", "val": "0"} v 0) -- 0x7f57e812b580 con 0x7f57e8073230 2024-04-24T02:07:37.754 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.754+0000 7f57e5ffb640 1 -- 172.21.15.57:0/1034298521 <== mon.0 v2:172.21.15.57:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 319496fe-d53f-40fe-a120-83451e8717ac v710) ==== 217+0+0 (crc 0 0 0) 0x7f57e000d330 con 0x7f57e8073230 2024-04-24T02:07:37.755 INFO:tasks.workunit.client.0.smithi057.stderr:set-quota max_bytes = 0 for pool 319496fe-d53f-40fe-a120-83451e8717ac 2024-04-24T02:07:37.755 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.755+0000 7f57e5ffb640 1 -- 172.21.15.57:0/1034298521 <== mon.0 v2:172.21.15.57:3300/0 10 ==== osd_map(710..710 src has 395..710) ==== 628+0+0 (crc 0 0 0) 0x7f57e0028c70 con 0x7f57e8073230 2024-04-24T02:07:37.756 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.755+0000 7f57e5ffb640 1 -- 172.21.15.57:0/1034298521 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=711}) -- 0x7f57d4040430 con 0x7f57e8073230 2024-04-24T02:07:37.757 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.756+0000 7f57ef26d640 1 -- 172.21.15.57:0/1034298521 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f57d4038980 msgr2=0x7f57d403ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:37.757 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.756+0000 7f57ef26d640 1 --2- 172.21.15.57:0/1034298521 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f57d4038980 0x7f57d403ae90 crc :-1 s=READY pgs=3954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:37.757 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.756+0000 7f57ef26d640 1 -- 172.21.15.57:0/1034298521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57e8073230 msgr2=0x7f57e8129ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:37.757 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.756+0000 7f57ef26d640 1 --2- 172.21.15.57:0/1034298521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57e8073230 0x7f57e8129ba0 crc :-1 s=READY pgs=12953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:37.757 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.756+0000 7f57ef26d640 1 -- 172.21.15.57:0/1034298521 shutdown_connections 2024-04-24T02:07:37.757 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.756+0000 7f57ef26d640 1 --2- 172.21.15.57:0/1034298521 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f57d4038980 0x7f57d403ae90 unknown :-1 s=CLOSED pgs=3954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:37.757 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.757+0000 7f57ef26d640 1 --2- 172.21.15.57:0/1034298521 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57e8073230 0x7f57e8129ba0 unknown :-1 s=CLOSED pgs=12953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:37.757 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.757+0000 7f57ef26d640 1 -- 172.21.15.57:0/1034298521 >> 172.21.15.57:0/1034298521 conn(0x7f57e80a0bd0 msgr2=0x7f57e8070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:07:37.757 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.757+0000 7f57ef26d640 1 -- 172.21.15.57:0/1034298521 shutdown_connections 2024-04-24T02:07:37.758 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.757+0000 7f57ef26d640 1 -- 172.21.15.57:0/1034298521 wait complete. 2024-04-24T02:07:37.766 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph osd pool set-quota 319496fe-d53f-40fe-a120-83451e8717ac max_objects 0 2024-04-24T02:07:37.862 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.854+0000 7fc92399d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:37.863 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.863+0000 7fc92399d640 1 Processor -- start 2024-04-24T02:07:37.863 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.863+0000 7fc92399d640 1 -- start start 2024-04-24T02:07:37.866 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.865+0000 7fc92399d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc91c12f660 0x7fc91c12fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:37.866 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.865+0000 7fc92399d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc91c12f230 con 0x7fc91c06bc10 2024-04-24T02:07:37.866 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.865+0000 7fc92399d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fc91c09cd20 con 0x7fc91c12f660 2024-04-24T02:07:37.866 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.865+0000 7fc921739640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc91c12f660 0x7fc91c12fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:37.866 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.865+0000 7fc920f38640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc91c06bc10 0x7fc91c06c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40666/0 (socket says 172.21.15.57:40666) 2024-04-24T02:07:37.866 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.865+0000 7fc920f38640 1 -- 172.21.15.57:0/2600820443 learned_addr learned my addr 172.21.15.57:0/2600820443 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T02:07:37.866 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.865+0000 7fc921739640 1 -- 172.21.15.57:0/2600820443 >> v1:172.21.15.57:6789/0 conn(0x7fc91c06bc10 legacy=0x7fc91c06c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:37.866 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.865+0000 7fc921739640 1 -- 172.21.15.57:0/2600820443 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc91c070160 con 0x7fc91c12f660 2024-04-24T02:07:37.866 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.865+0000 7fc913fff640 1 -- 172.21.15.57:0/2600820443 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3508759556 0 0) 0x7fc91c12f230 con 0x7fc91c06bc10 2024-04-24T02:07:37.867 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.866+0000 7fc921739640 1 --2- 172.21.15.57:0/2600820443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc91c12f660 0x7fc91c12fa70 crc :-1 s=READY pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=182f1b4a98955d7e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:37.867 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.866+0000 7fc913fff640 1 -- 172.21.15.57:0/2600820443 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc918009d80 con 0x7fc91c12f660 2024-04-24T02:07:37.867 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.866+0000 7fc913fff640 1 -- 172.21.15.57:0/2600820443 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc91800e230 con 0x7fc91c12f660 2024-04-24T02:07:37.867 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.866+0000 7fc913fff640 1 -- 172.21.15.57:0/2600820443 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc91800e4d0 con 0x7fc91c12f660 2024-04-24T02:07:37.868 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.866+0000 7fc92399d640 1 -- 172.21.15.57:0/2600820443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc91c12f660 msgr2=0x7fc91c12fa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:37.868 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.866+0000 7fc92399d640 1 --2- 172.21.15.57:0/2600820443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc91c12f660 0x7fc91c12fa70 crc :-1 s=READY pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:37.868 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.866+0000 7fc92399d640 1 -- 172.21.15.57:0/2600820443 shutdown_connections 2024-04-24T02:07:37.868 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.866+0000 7fc92399d640 1 --2- 172.21.15.57:0/2600820443 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc91c12f660 0x7fc91c12fa70 unknown :-1 s=CLOSED pgs=12955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:37.868 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.866+0000 7fc92399d640 1 -- 172.21.15.57:0/2600820443 >> 172.21.15.57:0/2600820443 conn(0x7fc91c0a08c0 msgr2=0x7fc91c0a0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:07:37.868 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.867+0000 7fc92399d640 1 -- 172.21.15.57:0/2600820443 shutdown_connections 2024-04-24T02:07:37.868 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.867+0000 7fc92399d640 1 -- 172.21.15.57:0/2600820443 wait complete. 2024-04-24T02:07:37.868 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.867+0000 7fc92399d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:07:37.869 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.868+0000 7fc92399d640 1 Processor -- start 2024-04-24T02:07:37.869 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.869+0000 7fc92399d640 1 -- start start 2024-04-24T02:07:37.871 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.870+0000 7fc92399d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc91c06bc10 0x7fc91c11ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:37.871 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.870+0000 7fc92399d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c11edc0 con 0x7fc91c06bc10 2024-04-24T02:07:37.871 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.870+0000 7fc921739640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc91c06bc10 0x7fc91c11ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:37.872 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.870+0000 7fc921739640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc91c06bc10 0x7fc91c11ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50446/0 (socket says 172.21.15.57:50446) 2024-04-24T02:07:37.872 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.870+0000 7fc921739640 1 -- 172.21.15.57:0/3682416689 learned_addr learned my addr 172.21.15.57:0/3682416689 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:07:37.872 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.870+0000 7fc921739640 1 -- 172.21.15.57:0/3682416689 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc91c12ee30 con 0x7fc91c06bc10 2024-04-24T02:07:37.872 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.871+0000 7fc921739640 1 --2- 172.21.15.57:0/3682416689 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc91c06bc10 0x7fc91c11ac30 crc :-1 s=READY pgs=12956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:37.872 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.871+0000 7fc911ffb640 1 -- 172.21.15.57:0/3682416689 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc918014540 con 0x7fc91c06bc10 2024-04-24T02:07:37.872 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.871+0000 7fc911ffb640 1 -- 172.21.15.57:0/3682416689 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc9180146a0 con 0x7fc91c06bc10 2024-04-24T02:07:37.872 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.871+0000 7fc92399d640 1 -- 172.21.15.57:0/3682416689 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc91c11d140 con 0x7fc91c06bc10 2024-04-24T02:07:37.872 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.871+0000 7fc911ffb640 1 -- 172.21.15.57:0/3682416689 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc918014940 con 0x7fc91c06bc10 2024-04-24T02:07:37.872 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.871+0000 7fc92399d640 1 -- 172.21.15.57:0/3682416689 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc91c11e2a0 con 0x7fc91c06bc10 2024-04-24T02:07:37.873 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.872+0000 7fc911ffb640 1 -- 172.21.15.57:0/3682416689 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fc918014af0 con 0x7fc91c06bc10 2024-04-24T02:07:37.874 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.872+0000 7fc92399d640 1 -- 172.21.15.57:0/3682416689 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc91c11d4e0 con 0x7fc91c06bc10 2024-04-24T02:07:37.874 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.872+0000 7fc911ffb640 1 --2- 172.21.15.57:0/3682416689 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fc900038980 0x7fc90003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:07:37.874 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.872+0000 7fc911ffb640 1 -- 172.21.15.57:0/3682416689 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(710..710 src has 395..710) ==== 4179+0+0 (crc 0 0 0) 0x7fc918019040 con 0x7fc91c06bc10 2024-04-24T02:07:37.874 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.872+0000 7fc911ffb640 1 -- 172.21.15.57:0/3682416689 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=711}) -- 0x7fc90003f390 con 0x7fc91c06bc10 2024-04-24T02:07:37.874 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.872+0000 7fc920f38640 1 --2- 172.21.15.57:0/3682416689 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fc900038980 0x7fc90003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:07:37.875 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.873+0000 7fc920f38640 1 --2- 172.21.15.57:0/3682416689 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fc900038980 0x7fc90003ae90 crc :-1 s=READY pgs=3955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:07:37.877 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:37.877+0000 7fc911ffb640 1 -- 172.21.15.57:0/3682416689 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fc918018190 con 0x7fc91c06bc10 2024-04-24T02:07:38.064 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:38.064+0000 7fc92399d640 1 -- 172.21.15.57:0/3682416689 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "field": "max_objects", "val": "0"} v 0) -- 0x7fc91c069870 con 0x7fc91c06bc10 2024-04-24T02:07:38.766 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:38.766+0000 7fc911ffb640 1 -- 172.21.15.57:0/3682416689 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 319496fe-d53f-40fe-a120-83451e8717ac v711) ==== 221+0+0 (crc 0 0 0) 0x7fc91800fb30 con 0x7fc91c06bc10 2024-04-24T02:07:38.770 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:38.770+0000 7fc911ffb640 1 -- 172.21.15.57:0/3682416689 <== mon.0 v2:172.21.15.57:3300/0 8 ==== osd_map(711..711 src has 395..711) ==== 628+0+0 (crc 0 0 0) 0x7fc918010e30 con 0x7fc91c06bc10 2024-04-24T02:07:38.771 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:38.770+0000 7fc911ffb640 1 -- 172.21.15.57:0/3682416689 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=712}) -- 0x7fc90003fd60 con 0x7fc91c06bc10 2024-04-24T02:07:38.876 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:38.876+0000 7fc92399d640 1 -- 172.21.15.57:0/3682416689 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "field": "max_objects", "val": "0"} v 0) -- 0x7fc91c0008d0 con 0x7fc91c06bc10 2024-04-24T02:07:39.774 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:39.774+0000 7fc911ffb640 1 -- 172.21.15.57:0/3682416689 <== mon.0 v2:172.21.15.57:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 319496fe-d53f-40fe-a120-83451e8717ac v712) ==== 221+0+0 (crc 0 0 0) 0x7fc91800fd10 con 0x7fc91c06bc10 2024-04-24T02:07:39.775 INFO:tasks.workunit.client.0.smithi057.stderr:set-quota max_objects = 0 for pool 319496fe-d53f-40fe-a120-83451e8717ac 2024-04-24T02:07:39.777 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:39.777+0000 7fc92399d640 1 -- 172.21.15.57:0/3682416689 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fc900038980 msgr2=0x7fc90003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:39.777 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:39.777+0000 7fc92399d640 1 --2- 172.21.15.57:0/3682416689 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fc900038980 0x7fc90003ae90 crc :-1 s=READY pgs=3955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:39.778 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:39.777+0000 7fc92399d640 1 -- 172.21.15.57:0/3682416689 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc91c06bc10 msgr2=0x7fc91c11ac30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:07:39.778 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:39.777+0000 7fc92399d640 1 --2- 172.21.15.57:0/3682416689 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc91c06bc10 0x7fc91c11ac30 crc :-1 s=READY pgs=12956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:39.778 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:39.777+0000 7fc92399d640 1 -- 172.21.15.57:0/3682416689 shutdown_connections 2024-04-24T02:07:39.778 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:39.777+0000 7fc92399d640 1 --2- 172.21.15.57:0/3682416689 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fc900038980 0x7fc90003ae90 unknown :-1 s=CLOSED pgs=3955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:39.778 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:39.777+0000 7fc92399d640 1 --2- 172.21.15.57:0/3682416689 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc91c06bc10 0x7fc91c11ac30 unknown :-1 s=CLOSED pgs=12956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:07:39.778 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:39.777+0000 7fc92399d640 1 -- 172.21.15.57:0/3682416689 >> 172.21.15.57:0/3682416689 conn(0x7fc91c0a08c0 msgr2=0x7fc91c1b8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:07:39.778 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:39.777+0000 7fc92399d640 1 -- 172.21.15.57:0/3682416689 shutdown_connections 2024-04-24T02:07:39.778 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:07:39.777+0000 7fc92399d640 1 -- 172.21.15.57:0/3682416689 wait complete. 2024-04-24T02:07:39.792 INFO:tasks.workunit.client.0.smithi057.stderr:+ sleep 30 2024-04-24T02:08:09.794 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph osd pool delete 319496fe-d53f-40fe-a120-83451e8717ac 319496fe-d53f-40fe-a120-83451e8717ac --yes-i-really-really-mean-it 2024-04-24T02:08:09.902 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.892+0000 7f13e34ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:09.903 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.902+0000 7f13e34ad640 1 Processor -- start 2024-04-24T02:08:09.904 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.903+0000 7f13e34ad640 1 -- start start 2024-04-24T02:08:09.907 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.904+0000 7f13e34ad640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f13dc135b00 0x7f13dc137f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:09.908 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.904+0000 7f13e34ad640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13dc130180 con 0x7f13dc12f660 2024-04-24T02:08:09.910 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.904+0000 7f13e34ad640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f13dc09cd20 con 0x7f13dc135b00 2024-04-24T02:08:09.910 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.904+0000 7f13e0a48640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f13dc135b00 0x7f13dc137f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:09.910 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.904+0000 7f13e1249640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f13dc12f660 0x7f13dc12fa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39770/0 (socket says 172.21.15.57:39770) 2024-04-24T02:08:09.910 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.904+0000 7f13e1249640 1 -- 172.21.15.57:0/3681667055 learned_addr learned my addr 172.21.15.57:0/3681667055 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T02:08:09.910 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.905+0000 7f13e0a48640 1 -- 172.21.15.57:0/3681667055 >> v1:172.21.15.57:6789/0 conn(0x7f13dc12f660 legacy=0x7f13dc12fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:09.910 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.905+0000 7f13e0a48640 1 -- 172.21.15.57:0/3681667055 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13dc12f230 con 0x7f13dc135b00 2024-04-24T02:08:09.910 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.905+0000 7f13d3fff640 1 -- 172.21.15.57:0/3681667055 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3167735005 0 0) 0x7f13dc130180 con 0x7f13dc12f660 2024-04-24T02:08:09.910 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.905+0000 7f13e0a48640 1 --2- 172.21.15.57:0/3681667055 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13dc135b00 0x7f13dc137f20 crc :-1 s=READY pgs=12958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7177e03fa4690d7d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:09.910 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.905+0000 7f13d3fff640 1 -- 172.21.15.57:0/3681667055 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f13cc009d80 con 0x7f13dc135b00 2024-04-24T02:08:09.910 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.905+0000 7f13d3fff640 1 -- 172.21.15.57:0/3681667055 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f13cc00e230 con 0x7f13dc135b00 2024-04-24T02:08:09.910 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.905+0000 7f13d3fff640 1 -- 172.21.15.57:0/3681667055 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f13cc00e4d0 con 0x7f13dc135b00 2024-04-24T02:08:09.911 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.906+0000 7f13e34ad640 1 -- 172.21.15.57:0/3681667055 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13dc135b00 msgr2=0x7f13dc137f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:09.911 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.906+0000 7f13e34ad640 1 --2- 172.21.15.57:0/3681667055 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13dc135b00 0x7f13dc137f20 crc :-1 s=READY pgs=12958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:09.911 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.906+0000 7f13e34ad640 1 -- 172.21.15.57:0/3681667055 shutdown_connections 2024-04-24T02:08:09.911 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.906+0000 7f13e34ad640 1 --2- 172.21.15.57:0/3681667055 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13dc135b00 0x7f13dc137f20 unknown :-1 s=CLOSED pgs=12958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:09.911 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.906+0000 7f13e34ad640 1 -- 172.21.15.57:0/3681667055 >> 172.21.15.57:0/3681667055 conn(0x7f13dc0a08c0 msgr2=0x7f13dc0a0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:09.911 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.906+0000 7f13e34ad640 1 -- 172.21.15.57:0/3681667055 shutdown_connections 2024-04-24T02:08:09.911 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.906+0000 7f13e34ad640 1 -- 172.21.15.57:0/3681667055 wait complete. 2024-04-24T02:08:09.911 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.906+0000 7f13e34ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:09.913 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.908+0000 7f13e34ad640 1 Processor -- start 2024-04-24T02:08:09.914 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.908+0000 7f13e34ad640 1 -- start start 2024-04-24T02:08:09.914 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.909+0000 7f13e34ad640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13dc12f660 0x7f13dc11bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:09.914 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.909+0000 7f13e34ad640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f13dc11cd70 con 0x7f13dc12f660 2024-04-24T02:08:09.914 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.910+0000 7f13e1249640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13dc12f660 0x7f13dc11bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:09.914 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.910+0000 7f13e1249640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13dc12f660 0x7f13dc11bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51628/0 (socket says 172.21.15.57:51628) 2024-04-24T02:08:09.914 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.910+0000 7f13e1249640 1 -- 172.21.15.57:0/40537765 learned_addr learned my addr 172.21.15.57:0/40537765 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:08:09.914 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.910+0000 7f13e1249640 1 -- 172.21.15.57:0/40537765 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13dc11e070 con 0x7f13dc12f660 2024-04-24T02:08:09.914 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.910+0000 7f13e1249640 1 --2- 172.21.15.57:0/40537765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13dc12f660 0x7f13dc11bb30 crc :-1 s=READY pgs=12959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:09.914 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.910+0000 7f13d1ffb640 1 -- 172.21.15.57:0/40537765 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f13d8004b80 con 0x7f13dc12f660 2024-04-24T02:08:09.914 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.910+0000 7f13d1ffb640 1 -- 172.21.15.57:0/40537765 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f13d8004ce0 con 0x7f13dc12f660 2024-04-24T02:08:09.914 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.910+0000 7f13e34ad640 1 -- 172.21.15.57:0/40537765 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13dc11e760 con 0x7f13dc12f660 2024-04-24T02:08:09.914 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.910+0000 7f13d1ffb640 1 -- 172.21.15.57:0/40537765 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f13d8007120 con 0x7f13dc12f660 2024-04-24T02:08:09.915 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.910+0000 7f13e34ad640 1 -- 172.21.15.57:0/40537765 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13dc11f000 con 0x7f13dc12f660 2024-04-24T02:08:09.915 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.911+0000 7f13d1ffb640 1 -- 172.21.15.57:0/40537765 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f13d80072d0 con 0x7f13dc12f660 2024-04-24T02:08:09.915 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.911+0000 7f13d1ffb640 1 --2- 172.21.15.57:0/40537765 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f13c0038980 0x7f13c003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:09.915 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.911+0000 7f13e34ad640 1 -- 172.21.15.57:0/40537765 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13dc069870 con 0x7f13dc12f660 2024-04-24T02:08:09.915 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.912+0000 7f13d1ffb640 1 -- 172.21.15.57:0/40537765 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(712..712 src has 395..712) ==== 4179+0+0 (crc 0 0 0) 0x7f13d8048960 con 0x7f13dc12f660 2024-04-24T02:08:09.915 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.912+0000 7f13d1ffb640 1 -- 172.21.15.57:0/40537765 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=713}) -- 0x7f13c003f330 con 0x7f13dc12f660 2024-04-24T02:08:09.915 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.912+0000 7f13e0a48640 1 --2- 172.21.15.57:0/40537765 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f13c0038980 0x7f13c003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:09.915 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.912+0000 7f13e0a48640 1 --2- 172.21.15.57:0/40537765 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f13c0038980 0x7f13c003ae90 crc :-1 s=READY pgs=3956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:09.918 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:09.917+0000 7f13d1ffb640 1 -- 172.21.15.57:0/40537765 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f13d800f230 con 0x7f13dc12f660 2024-04-24T02:08:10.107 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:10.106+0000 7f13e34ad640 1 -- 172.21.15.57:0/40537765 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "pool2": "319496fe-d53f-40fe-a120-83451e8717ac", "yes_i_really_really_mean_it": true} v 0) -- 0x7f13dc070160 con 0x7f13dc12f660 2024-04-24T02:08:10.852 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:10.851+0000 7f13d1ffb640 1 -- 172.21.15.57:0/40537765 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "pool2": "319496fe-d53f-40fe-a120-83451e8717ac", "yes_i_really_really_mean_it": true}]=0 pool '319496fe-d53f-40fe-a120-83451e8717ac' removed v713) ==== 248+0+0 (crc 0 0 0) 0x7f13d800a5d0 con 0x7f13dc12f660 2024-04-24T02:08:10.854 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:10.853+0000 7f13d1ffb640 1 -- 172.21.15.57:0/40537765 <== mon.0 v2:172.21.15.57:3300/0 8 ==== osd_map(713..713 src has 395..713) ==== 296+0+0 (crc 0 0 0) 0x7f13d8006550 con 0x7f13dc12f660 2024-04-24T02:08:10.854 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:10.853+0000 7f13d1ffb640 1 -- 172.21.15.57:0/40537765 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=714}) -- 0x7f13c0040100 con 0x7f13dc12f660 2024-04-24T02:08:10.969 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:10.967+0000 7f13e34ad640 1 -- 172.21.15.57:0/40537765 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "pool2": "319496fe-d53f-40fe-a120-83451e8717ac", "yes_i_really_really_mean_it": true} v 0) -- 0x7f13dc11e8f0 con 0x7f13dc12f660 2024-04-24T02:08:10.969 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:10.968+0000 7f13d1ffb640 1 -- 172.21.15.57:0/40537765 <== mon.0 v2:172.21.15.57:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "319496fe-d53f-40fe-a120-83451e8717ac", "pool2": "319496fe-d53f-40fe-a120-83451e8717ac", "yes_i_really_really_mean_it": true}]=0 pool '319496fe-d53f-40fe-a120-83451e8717ac' does not exist v713) ==== 255+0+0 (crc 0 0 0) 0x7f13d800a7b0 con 0x7f13dc12f660 2024-04-24T02:08:10.970 INFO:tasks.workunit.client.0.smithi057.stderr:pool '319496fe-d53f-40fe-a120-83451e8717ac' does not exist 2024-04-24T02:08:10.972 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:10.970+0000 7f13e34ad640 1 -- 172.21.15.57:0/40537765 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f13c0038980 msgr2=0x7f13c003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:10.972 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:10.970+0000 7f13e34ad640 1 --2- 172.21.15.57:0/40537765 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f13c0038980 0x7f13c003ae90 crc :-1 s=READY pgs=3956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:10.972 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:10.970+0000 7f13e34ad640 1 -- 172.21.15.57:0/40537765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13dc12f660 msgr2=0x7f13dc11bb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:10.972 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:10.970+0000 7f13e34ad640 1 --2- 172.21.15.57:0/40537765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13dc12f660 0x7f13dc11bb30 crc :-1 s=READY pgs=12959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:10.972 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:10.970+0000 7f13e34ad640 1 -- 172.21.15.57:0/40537765 shutdown_connections 2024-04-24T02:08:10.972 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:10.970+0000 7f13e34ad640 1 --2- 172.21.15.57:0/40537765 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f13c0038980 0x7f13c003ae90 unknown :-1 s=CLOSED pgs=3956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:10.972 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:10.970+0000 7f13e34ad640 1 --2- 172.21.15.57:0/40537765 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13dc12f660 0x7f13dc11bb30 unknown :-1 s=CLOSED pgs=12959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:10.972 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:10.970+0000 7f13e34ad640 1 -- 172.21.15.57:0/40537765 >> 172.21.15.57:0/40537765 conn(0x7f13dc0a08c0 msgr2=0x7f13dc09e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:10.972 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:10.970+0000 7f13e34ad640 1 -- 172.21.15.57:0/40537765 shutdown_connections 2024-04-24T02:08:10.972 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:10.970+0000 7f13e34ad640 1 -- 172.21.15.57:0/40537765 wait complete. 2024-04-24T02:08:10.982 INFO:tasks.workunit.client.0.smithi057.stderr:+ ceph osd pool delete 09b3c512-40ed-4aad-9a96-edbc8decb8dc 09b3c512-40ed-4aad-9a96-edbc8decb8dc --yes-i-really-really-mean-it 2024-04-24T02:08:11.079 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.069+0000 7f622ca6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:11.080 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.078+0000 7f622ca6d640 1 Processor -- start 2024-04-24T02:08:11.080 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.079+0000 7f622ca6d640 1 -- start start 2024-04-24T02:08:11.082 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.080+0000 7f622ca6d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6228135b00 0x7f6228137f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:11.083 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.080+0000 7f622ca6d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6228130180 con 0x7f622812f660 2024-04-24T02:08:11.083 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.080+0000 7f622ca6d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f622809cd20 con 0x7f6228135b00 2024-04-24T02:08:11.083 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.080+0000 7f6225d9b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6228135b00 0x7f6228137f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:11.083 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.080+0000 7f622659c640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f622812f660 0x7f622812fa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39782/0 (socket says 172.21.15.57:39782) 2024-04-24T02:08:11.083 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.080+0000 7f622659c640 1 -- 172.21.15.57:0/4039155472 learned_addr learned my addr 172.21.15.57:0/4039155472 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T02:08:11.083 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.081+0000 7f6225d9b640 1 -- 172.21.15.57:0/4039155472 >> v1:172.21.15.57:6789/0 conn(0x7f622812f660 legacy=0x7f622812fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:11.083 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.081+0000 7f6225d9b640 1 -- 172.21.15.57:0/4039155472 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f622812f230 con 0x7f6228135b00 2024-04-24T02:08:11.083 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.081+0000 7f6225d9b640 1 --2- 172.21.15.57:0/4039155472 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6228135b00 0x7f6228137f20 crc :-1 s=READY pgs=12961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c277dcca0ca4885b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:11.083 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.081+0000 7f622559a640 1 -- 172.21.15.57:0/4039155472 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f621c009d80 con 0x7f6228135b00 2024-04-24T02:08:11.083 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.081+0000 7f622559a640 1 -- 172.21.15.57:0/4039155472 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f621c00e230 con 0x7f6228135b00 2024-04-24T02:08:11.083 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.081+0000 7f622559a640 1 -- 172.21.15.57:0/4039155472 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f621c00e4d0 con 0x7f6228135b00 2024-04-24T02:08:11.084 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.082+0000 7f622ca6d640 1 -- 172.21.15.57:0/4039155472 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6228135b00 msgr2=0x7f6228137f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:11.084 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.082+0000 7f622ca6d640 1 --2- 172.21.15.57:0/4039155472 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6228135b00 0x7f6228137f20 crc :-1 s=READY pgs=12961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:11.084 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.082+0000 7f622ca6d640 1 -- 172.21.15.57:0/4039155472 shutdown_connections 2024-04-24T02:08:11.085 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.082+0000 7f622ca6d640 1 --2- 172.21.15.57:0/4039155472 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6228135b00 0x7f6228137f20 unknown :-1 s=CLOSED pgs=12961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:11.085 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.082+0000 7f622ca6d640 1 -- 172.21.15.57:0/4039155472 >> 172.21.15.57:0/4039155472 conn(0x7f62280a08c0 msgr2=0x7f62280a0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:11.085 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.082+0000 7f622ca6d640 1 -- 172.21.15.57:0/4039155472 shutdown_connections 2024-04-24T02:08:11.085 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.082+0000 7f622ca6d640 1 -- 172.21.15.57:0/4039155472 wait complete. 2024-04-24T02:08:11.085 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.082+0000 7f622ca6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:11.086 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.084+0000 7f622ca6d640 1 Processor -- start 2024-04-24T02:08:11.086 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.084+0000 7f622ca6d640 1 -- start start 2024-04-24T02:08:11.088 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.085+0000 7f622ca6d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f622812f660 0x7f622809aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:11.088 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.085+0000 7f622ca6d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f622811f4a0 con 0x7f622812f660 2024-04-24T02:08:11.088 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.086+0000 7f622659c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f622812f660 0x7f622809aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:11.088 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.086+0000 7f622659c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f622812f660 0x7f622809aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51650/0 (socket says 172.21.15.57:51650) 2024-04-24T02:08:11.088 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.086+0000 7f622659c640 1 -- 172.21.15.57:0/1608739373 learned_addr learned my addr 172.21.15.57:0/1608739373 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:08:11.088 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.086+0000 7f622659c640 1 -- 172.21.15.57:0/1608739373 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62281200d0 con 0x7f622812f660 2024-04-24T02:08:11.088 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.086+0000 7f622659c640 1 --2- 172.21.15.57:0/1608739373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f622812f660 0x7f622809aa60 crc :-1 s=READY pgs=12962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:11.088 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.086+0000 7f6216ffd640 1 -- 172.21.15.57:0/1608739373 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6220005a60 con 0x7f622812f660 2024-04-24T02:08:11.088 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.086+0000 7f6216ffd640 1 -- 172.21.15.57:0/1608739373 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f6220005bc0 con 0x7f622812f660 2024-04-24T02:08:11.088 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.086+0000 7f622ca6d640 1 -- 172.21.15.57:0/1608739373 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f622809c650 con 0x7f622812f660 2024-04-24T02:08:11.088 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.086+0000 7f6216ffd640 1 -- 172.21.15.57:0/1608739373 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f6220005e60 con 0x7f622812f660 2024-04-24T02:08:11.088 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.086+0000 7f622ca6d640 1 -- 172.21.15.57:0/1608739373 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f622812eef0 con 0x7f622812f660 2024-04-24T02:08:11.090 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.087+0000 7f6216ffd640 1 -- 172.21.15.57:0/1608739373 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f62200070b0 con 0x7f622812f660 2024-04-24T02:08:11.090 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.087+0000 7f622ca6d640 1 -- 172.21.15.57:0/1608739373 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6228121070 con 0x7f622812f660 2024-04-24T02:08:11.090 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.088+0000 7f6216ffd640 1 --2- 172.21.15.57:0/1608739373 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f6208038980 0x7f620803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:11.090 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.088+0000 7f6216ffd640 1 -- 172.21.15.57:0/1608739373 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(713..713 src has 395..713) ==== 3791+0+0 (crc 0 0 0) 0x7f6220048580 con 0x7f622812f660 2024-04-24T02:08:11.090 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.088+0000 7f6216ffd640 1 -- 172.21.15.57:0/1608739373 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=714}) -- 0x7f620803eb90 con 0x7f622812f660 2024-04-24T02:08:11.090 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.088+0000 7f6225d9b640 1 --2- 172.21.15.57:0/1608739373 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f6208038980 0x7f620803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:11.090 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.088+0000 7f6225d9b640 1 --2- 172.21.15.57:0/1608739373 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f6208038980 0x7f620803ae90 crc :-1 s=READY pgs=3957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:11.094 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.093+0000 7f6216ffd640 1 -- 172.21.15.57:0/1608739373 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f6228121070 con 0x7f622812f660 2024-04-24T02:08:11.279 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.278+0000 7f622ca6d640 1 -- 172.21.15.57:0/1608739373 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "09b3c512-40ed-4aad-9a96-edbc8decb8dc", "pool2": "09b3c512-40ed-4aad-9a96-edbc8decb8dc", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6228121070 con 0x7f622812f660 2024-04-24T02:08:11.868 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.867+0000 7f6216ffd640 1 -- 172.21.15.57:0/1608739373 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "09b3c512-40ed-4aad-9a96-edbc8decb8dc", "pool2": "09b3c512-40ed-4aad-9a96-edbc8decb8dc", "yes_i_really_really_mean_it": true}]=0 pool '09b3c512-40ed-4aad-9a96-edbc8decb8dc' removed v714) ==== 248+0+0 (crc 0 0 0) 0x7f6228121070 con 0x7f622812f660 2024-04-24T02:08:11.868 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.867+0000 7f6216ffd640 1 -- 172.21.15.57:0/1608739373 <== mon.0 v2:172.21.15.57:3300/0 8 ==== osd_map(714..714 src has 395..714) ==== 296+0+0 (crc 0 0 0) 0x7f622000d510 con 0x7f622812f660 2024-04-24T02:08:11.868 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.867+0000 7f6216ffd640 1 -- 172.21.15.57:0/1608739373 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=715}) -- 0x7f620803f830 con 0x7f622812f660 2024-04-24T02:08:11.981 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.980+0000 7f622ca6d640 1 -- 172.21.15.57:0/1608739373 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "09b3c512-40ed-4aad-9a96-edbc8decb8dc", "pool2": "09b3c512-40ed-4aad-9a96-edbc8decb8dc", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6228121070 con 0x7f622812f660 2024-04-24T02:08:11.982 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.980+0000 7f6216ffd640 1 -- 172.21.15.57:0/1608739373 <== mon.0 v2:172.21.15.57:3300/0 9 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "09b3c512-40ed-4aad-9a96-edbc8decb8dc", "pool2": "09b3c512-40ed-4aad-9a96-edbc8decb8dc", "yes_i_really_really_mean_it": true}]=0 pool '09b3c512-40ed-4aad-9a96-edbc8decb8dc' does not exist v714) ==== 255+0+0 (crc 0 0 0) 0x7f6228121070 con 0x7f622812f660 2024-04-24T02:08:11.982 INFO:tasks.workunit.client.0.smithi057.stderr:pool '09b3c512-40ed-4aad-9a96-edbc8decb8dc' does not exist 2024-04-24T02:08:11.987 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.984+0000 7f622ca6d640 1 -- 172.21.15.57:0/1608739373 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f6208038980 msgr2=0x7f620803ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:11.987 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.984+0000 7f622ca6d640 1 --2- 172.21.15.57:0/1608739373 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f6208038980 0x7f620803ae90 crc :-1 s=READY pgs=3957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:11.987 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.984+0000 7f622ca6d640 1 -- 172.21.15.57:0/1608739373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f622812f660 msgr2=0x7f622809aa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:11.987 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.984+0000 7f622ca6d640 1 --2- 172.21.15.57:0/1608739373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f622812f660 0x7f622809aa60 crc :-1 s=READY pgs=12962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:11.987 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.984+0000 7f622ca6d640 1 -- 172.21.15.57:0/1608739373 shutdown_connections 2024-04-24T02:08:11.987 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.984+0000 7f622ca6d640 1 --2- 172.21.15.57:0/1608739373 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f6208038980 0x7f620803ae90 unknown :-1 s=CLOSED pgs=3957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:11.987 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.984+0000 7f622ca6d640 1 --2- 172.21.15.57:0/1608739373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f622812f660 0x7f622809aa60 unknown :-1 s=CLOSED pgs=12962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:11.987 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.984+0000 7f622ca6d640 1 -- 172.21.15.57:0/1608739373 >> 172.21.15.57:0/1608739373 conn(0x7f62280a08c0 msgr2=0x7f62281bac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:11.987 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.984+0000 7f622ca6d640 1 -- 172.21.15.57:0/1608739373 shutdown_connections 2024-04-24T02:08:11.988 INFO:tasks.workunit.client.0.smithi057.stderr:2024-04-24T02:08:11.984+0000 7f622ca6d640 1 -- 172.21.15.57:0/1608739373 wait complete. 2024-04-24T02:08:12.003 INFO:tasks.workunit.client.0.smithi057.stderr:+ echo OK 2024-04-24T02:08:12.004 INFO:tasks.workunit.client.0.smithi057.stdout:OK 2024-04-24T02:08:12.005 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-24T02:08:12.005 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-24T02:08:12.073 INFO:tasks.workunit:Stopping ['rados/test.sh --crimson', 'rados/test_pool_quota.sh'] on client.0... 2024-04-24T02:08:12.073 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-24T02:08:12.423 DEBUG:teuthology.parallel:result is None 2024-04-24T02:08:12.423 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-24T02:08:12.448 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-24T02:08:12.448 DEBUG:teuthology.orchestra.run.smithi057:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-04-24T02:08:12.507 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-04-24T02:08:12.508 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-24T02:08:12.517 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-24T02:08:12.517 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T02:08:12.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.654+0000 7fb9c246d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:12.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.660+0000 7fb9c246d640 1 Processor -- start 2024-04-24T02:08:12.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.660+0000 7fb9c246d640 1 -- start start 2024-04-24T02:08:12.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.661+0000 7fb9c246d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb9bc09d020 0x7fb9bc09b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:12.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.661+0000 7fb9c246d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9bc09afb0 con 0x7fb9bc09b900 2024-04-24T02:08:12.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.661+0000 7fb9c246d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fb9bc0a3c80 con 0x7fb9bc09d020 2024-04-24T02:08:12.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.661+0000 7fb9bbfff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb9bc09d020 0x7fb9bc09b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:12.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.661+0000 7fb9bb7fe640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb9bc09b900 0x7fb9bc132aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39794/0 (socket says 172.21.15.57:39794) 2024-04-24T02:08:12.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.661+0000 7fb9bb7fe640 1 -- 172.21.15.57:0/549847328 learned_addr learned my addr 172.21.15.57:0/549847328 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T02:08:12.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.662+0000 7fb9bbfff640 1 -- 172.21.15.57:0/549847328 >> v1:172.21.15.57:6789/0 conn(0x7fb9bc09b900 legacy=0x7fb9bc132aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:12.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.662+0000 7fb9bbfff640 1 -- 172.21.15.57:0/549847328 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9bc0711a0 con 0x7fb9bc09d020 2024-04-24T02:08:12.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.662+0000 7fb9baffd640 1 -- 172.21.15.57:0/549847328 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3536164079 0 0) 0x7fb9bc09afb0 con 0x7fb9bc09b900 2024-04-24T02:08:12.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.662+0000 7fb9bbfff640 1 --2- 172.21.15.57:0/549847328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9bc09d020 0x7fb9bc09b3c0 crc :-1 s=READY pgs=12964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd13286f79291 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:12.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.662+0000 7fb9baffd640 1 -- 172.21.15.57:0/549847328 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb9ac009d90 con 0x7fb9bc09d020 2024-04-24T02:08:12.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.662+0000 7fb9baffd640 1 -- 172.21.15.57:0/549847328 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb9ac00e230 con 0x7fb9bc09d020 2024-04-24T02:08:12.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.662+0000 7fb9baffd640 1 -- 172.21.15.57:0/549847328 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb9ac00e4d0 con 0x7fb9bc09d020 2024-04-24T02:08:12.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.663+0000 7fb9c246d640 1 -- 172.21.15.57:0/549847328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9bc09d020 msgr2=0x7fb9bc09b3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:12.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.663+0000 7fb9c246d640 1 --2- 172.21.15.57:0/549847328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9bc09d020 0x7fb9bc09b3c0 crc :-1 s=READY pgs=12964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:12.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.663+0000 7fb9c246d640 1 -- 172.21.15.57:0/549847328 shutdown_connections 2024-04-24T02:08:12.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.663+0000 7fb9c246d640 1 --2- 172.21.15.57:0/549847328 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9bc09d020 0x7fb9bc09b3c0 unknown :-1 s=CLOSED pgs=12964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:12.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.663+0000 7fb9c246d640 1 -- 172.21.15.57:0/549847328 >> 172.21.15.57:0/549847328 conn(0x7fb9bc0a2df0 msgr2=0x7fb9bc0a3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:12.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.663+0000 7fb9c246d640 1 -- 172.21.15.57:0/549847328 shutdown_connections 2024-04-24T02:08:12.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.663+0000 7fb9c246d640 1 -- 172.21.15.57:0/549847328 wait complete. 2024-04-24T02:08:12.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.663+0000 7fb9c246d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:12.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.665+0000 7fb9c246d640 1 Processor -- start 2024-04-24T02:08:12.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.665+0000 7fb9c246d640 1 -- start start 2024-04-24T02:08:12.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.666+0000 7fb9c246d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9bc09b900 0x7fb9bc11f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:12.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.666+0000 7fb9c246d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc1304a0 con 0x7fb9bc09b900 2024-04-24T02:08:12.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.667+0000 7fb9bbfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9bc09b900 0x7fb9bc11f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:12.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.667+0000 7fb9bbfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9bc09b900 0x7fb9bc11f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51672/0 (socket says 172.21.15.57:51672) 2024-04-24T02:08:12.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.667+0000 7fb9bbfff640 1 -- 172.21.15.57:0/1020647566 learned_addr learned my addr 172.21.15.57:0/1020647566 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:08:12.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.667+0000 7fb9bbfff640 1 -- 172.21.15.57:0/1020647566 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9bc120500 con 0x7fb9bc09b900 2024-04-24T02:08:12.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.667+0000 7fb9bbfff640 1 --2- 172.21.15.57:0/1020647566 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9bc09b900 0x7fb9bc11f140 crc :-1 s=READY pgs=12965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:12.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.667+0000 7fb9b8ff9640 1 -- 172.21.15.57:0/1020647566 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb9ac013610 con 0x7fb9bc09b900 2024-04-24T02:08:12.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.667+0000 7fb9b8ff9640 1 -- 172.21.15.57:0/1020647566 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb9ac013770 con 0x7fb9bc09b900 2024-04-24T02:08:12.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.667+0000 7fb9c246d640 1 -- 172.21.15.57:0/1020647566 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9bc123120 con 0x7fb9bc09b900 2024-04-24T02:08:12.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.667+0000 7fb9b8ff9640 1 -- 172.21.15.57:0/1020647566 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb9ac013a10 con 0x7fb9bc09b900 2024-04-24T02:08:12.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.667+0000 7fb9c246d640 1 -- 172.21.15.57:0/1020647566 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9bc1201f0 con 0x7fb9bc09b900 2024-04-24T02:08:12.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.668+0000 7fb9b8ff9640 1 -- 172.21.15.57:0/1020647566 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fb9ac013bc0 con 0x7fb9bc09b900 2024-04-24T02:08:12.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.668+0000 7fb9c246d640 1 -- 172.21.15.57:0/1020647566 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9bc1229c0 con 0x7fb9bc09b900 2024-04-24T02:08:12.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.669+0000 7fb9b8ff9640 1 --2- 172.21.15.57:0/1020647566 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fb9a8038980 0x7fb9a803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:12.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.669+0000 7fb9b8ff9640 1 -- 172.21.15.57:0/1020647566 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(714..714 src has 395..714) ==== 3403+0+0 (crc 0 0 0) 0x7fb9ac018040 con 0x7fb9bc09b900 2024-04-24T02:08:12.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.669+0000 7fb9bb7fe640 1 --2- 172.21.15.57:0/1020647566 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fb9a8038980 0x7fb9a803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:12.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.670+0000 7fb9bb7fe640 1 --2- 172.21.15.57:0/1020647566 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fb9a8038980 0x7fb9a803ae90 crc :-1 s=READY pgs=3958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:12.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.674+0000 7fb9b8ff9640 1 -- 172.21.15.57:0/1020647566 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fb9ac018c70 con 0x7fb9bc09b900 2024-04-24T02:08:12.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.856+0000 7fb9c246d640 1 -- 172.21.15.57:0/1020647566 --> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb9bc09bd10 con 0x7fb9a8038980 2024-04-24T02:08:12.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.860+0000 7fb9b8ff9640 1 -- 172.21.15.57:0/1020647566 <== mgr.4101 v2:172.21.15.84:6800/1747524692 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109148 (crc 0 0 0) 0x7fb9b00070b0 con 0x7fb9a8038980 2024-04-24T02:08:12.862 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T02:08:12.863 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-24T02:08:12.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.862+0000 7fb9c246d640 1 -- 172.21.15.57:0/1020647566 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fb9a8038980 msgr2=0x7fb9a803ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:12.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.863+0000 7fb9c246d640 1 --2- 172.21.15.57:0/1020647566 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fb9a8038980 0x7fb9a803ae90 crc :-1 s=READY pgs=3958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:12.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.863+0000 7fb9c246d640 1 -- 172.21.15.57:0/1020647566 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9bc09b900 msgr2=0x7fb9bc11f140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:12.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.863+0000 7fb9c246d640 1 --2- 172.21.15.57:0/1020647566 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9bc09b900 0x7fb9bc11f140 crc :-1 s=READY pgs=12965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:12.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.863+0000 7fb9c246d640 1 -- 172.21.15.57:0/1020647566 shutdown_connections 2024-04-24T02:08:12.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.863+0000 7fb9c246d640 1 --2- 172.21.15.57:0/1020647566 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fb9a8038980 0x7fb9a803ae90 unknown :-1 s=CLOSED pgs=3958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:12.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.863+0000 7fb9c246d640 1 --2- 172.21.15.57:0/1020647566 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9bc09b900 0x7fb9bc11f140 unknown :-1 s=CLOSED pgs=12965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:12.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.863+0000 7fb9c246d640 1 -- 172.21.15.57:0/1020647566 >> 172.21.15.57:0/1020647566 conn(0x7fb9bc0a2df0 msgr2=0x7fb9bc1328b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:12.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.863+0000 7fb9c246d640 1 -- 172.21.15.57:0/1020647566 shutdown_connections 2024-04-24T02:08:12.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.863+0000 7fb9c246d640 1 -- 172.21.15.57:0/1020647566 wait complete. 2024-04-24T02:08:12.875 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":1295,"stamp":"2024-04-24T02:08:11.868848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590373,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":97,"num_write":144,"num_write_kb":1901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":296792,"kb_used_data":15480,"kb_used_omap":0,"kb_used_meta":281280,"kb_avail":419133608,"statfs":{"total":429496729600,"available":429192814592,"internally_reserved":0,"allocated":15851520,"data_stored":7088845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":288030720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-296900,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.675156"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1269,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.324677+0000","last_change":"2024-04-24T01:54:29.908821+0000","last_active":"2024-04-24T02:07:40.324677+0000","last_peered":"2024-04-24T02:07:40.324677+0000","last_clean":"2024-04-24T02:07:40.324677+0000","last_became_active":"2024-04-24T01:54:29.899903+0000","last_became_peered":"2024-04-24T01:54:29.899903+0000","last_unstale":"2024-04-24T02:07:40.324677+0000","last_undegraded":"2024-04-24T02:07:40.324677+0000","last_fullsized":"2024-04-24T02:07:40.324677+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.857268+0000","last_change":"2024-04-24T01:54:29.967629+0000","last_active":"2024-04-24T02:07:39.857268+0000","last_peered":"2024-04-24T02:07:39.857268+0000","last_clean":"2024-04-24T02:07:39.857268+0000","last_became_active":"2024-04-24T01:54:29.955445+0000","last_became_peered":"2024-04-24T01:54:29.955445+0000","last_unstale":"2024-04-24T02:07:39.857268+0000","last_undegraded":"2024-04-24T02:07:39.857268+0000","last_fullsized":"2024-04-24T02:07:39.857268+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.144489+0000","last_change":"2024-04-24T01:54:29.885625+0000","last_active":"2024-04-24T02:07:40.144489+0000","last_peered":"2024-04-24T02:07:40.144489+0000","last_clean":"2024-04-24T02:07:40.144489+0000","last_became_active":"2024-04-24T01:54:29.877273+0000","last_became_peered":"2024-04-24T01:54:29.877273+0000","last_unstale":"2024-04-24T02:07:40.144489+0000","last_undegraded":"2024-04-24T02:07:40.144489+0000","last_fullsized":"2024-04-24T02:07:40.144489+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1237,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.160927+0000","last_change":"2024-04-24T01:54:29.885696+0000","last_active":"2024-04-24T02:07:40.160927+0000","last_peered":"2024-04-24T02:07:40.160927+0000","last_clean":"2024-04-24T02:07:40.160927+0000","last_became_active":"2024-04-24T01:54:29.878778+0000","last_became_peered":"2024-04-24T01:54:29.878778+0000","last_unstale":"2024-04-24T02:07:40.160927+0000","last_undegraded":"2024-04-24T02:07:40.160927+0000","last_fullsized":"2024-04-24T02:07:40.160927+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1269,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.339109+0000","last_change":"2024-04-24T01:54:29.953603+0000","last_active":"2024-04-24T02:07:40.339109+0000","last_peered":"2024-04-24T02:07:40.339109+0000","last_clean":"2024-04-24T02:07:40.339109+0000","last_became_active":"2024-04-24T01:54:29.938885+0000","last_became_peered":"2024-04-24T01:54:29.938885+0000","last_unstale":"2024-04-24T02:07:40.339109+0000","last_undegraded":"2024-04-24T02:07:40.339109+0000","last_fullsized":"2024-04-24T02:07:40.339109+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.812793+0000","last_change":"2024-04-24T01:54:29.937576+0000","last_active":"2024-04-24T02:07:39.812793+0000","last_peered":"2024-04-24T02:07:39.812793+0000","last_clean":"2024-04-24T02:07:39.812793+0000","last_became_active":"2024-04-24T01:54:29.925475+0000","last_became_peered":"2024-04-24T01:54:29.925475+0000","last_unstale":"2024-04-24T02:07:39.812793+0000","last_undegraded":"2024-04-24T02:07:39.812793+0000","last_fullsized":"2024-04-24T02:07:39.812793+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.866141+0000","last_change":"2024-04-24T01:54:30.009375+0000","last_active":"2024-04-24T02:07:39.866141+0000","last_peered":"2024-04-24T02:07:39.866141+0000","last_clean":"2024-04-24T02:07:39.866141+0000","last_became_active":"2024-04-24T01:54:30.002762+0000","last_became_peered":"2024-04-24T01:54:30.002762+0000","last_unstale":"2024-04-24T02:07:39.866141+0000","last_undegraded":"2024-04-24T02:07:39.866141+0000","last_fullsized":"2024-04-24T02:07:39.866141+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.886419+0000","last_change":"2024-04-24T01:54:29.958936+0000","last_active":"2024-04-24T02:07:39.886419+0000","last_peered":"2024-04-24T02:07:39.886419+0000","last_clean":"2024-04-24T02:07:39.886419+0000","last_became_active":"2024-04-24T01:54:29.940930+0000","last_became_peered":"2024-04-24T01:54:29.940930+0000","last_unstale":"2024-04-24T02:07:39.886419+0000","last_undegraded":"2024-04-24T02:07:39.886419+0000","last_fullsized":"2024-04-24T02:07:39.886419+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1237,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.169469+0000","last_change":"2024-04-24T01:54:29.927605+0000","last_active":"2024-04-24T02:07:40.169469+0000","last_peered":"2024-04-24T02:07:40.169469+0000","last_clean":"2024-04-24T02:07:40.169469+0000","last_became_active":"2024-04-24T01:54:29.915996+0000","last_became_peered":"2024-04-24T01:54:29.915996+0000","last_unstale":"2024-04-24T02:07:40.169469+0000","last_undegraded":"2024-04-24T02:07:40.169469+0000","last_fullsized":"2024-04-24T02:07:40.169469+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.158355+0000","last_change":"2024-04-24T01:54:29.937993+0000","last_active":"2024-04-24T02:07:40.158355+0000","last_peered":"2024-04-24T02:07:40.158355+0000","last_clean":"2024-04-24T02:07:40.158355+0000","last_became_active":"2024-04-24T01:54:29.932001+0000","last_became_peered":"2024-04-24T01:54:29.932001+0000","last_unstale":"2024-04-24T02:07:40.158355+0000","last_undegraded":"2024-04-24T02:07:40.158355+0000","last_fullsized":"2024-04-24T02:07:40.158355+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1237,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.114455+0000","last_change":"2024-04-24T01:54:29.983449+0000","last_active":"2024-04-24T02:07:40.114455+0000","last_peered":"2024-04-24T02:07:40.114455+0000","last_clean":"2024-04-24T02:07:40.114455+0000","last_became_active":"2024-04-24T01:54:29.977785+0000","last_became_peered":"2024-04-24T01:54:29.977785+0000","last_unstale":"2024-04-24T02:07:40.114455+0000","last_undegraded":"2024-04-24T02:07:40.114455+0000","last_fullsized":"2024-04-24T02:07:40.114455+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.892640+0000","last_change":"2024-04-24T01:54:29.984917+0000","last_active":"2024-04-24T02:07:39.892640+0000","last_peered":"2024-04-24T02:07:39.892640+0000","last_clean":"2024-04-24T02:07:39.892640+0000","last_became_active":"2024-04-24T01:54:29.974222+0000","last_became_peered":"2024-04-24T01:54:29.974222+0000","last_unstale":"2024-04-24T02:07:39.892640+0000","last_undegraded":"2024-04-24T02:07:39.892640+0000","last_fullsized":"2024-04-24T02:07:39.892640+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1237,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.102021+0000","last_change":"2024-04-24T01:54:30.012455+0000","last_active":"2024-04-24T02:07:40.102021+0000","last_peered":"2024-04-24T02:07:40.102021+0000","last_clean":"2024-04-24T02:07:40.102021+0000","last_became_active":"2024-04-24T01:54:30.006792+0000","last_became_peered":"2024-04-24T01:54:30.006792+0000","last_unstale":"2024-04-24T02:07:40.102021+0000","last_undegraded":"2024-04-24T02:07:40.102021+0000","last_fullsized":"2024-04-24T02:07:40.102021+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1237,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.134415+0000","last_change":"2024-04-24T01:54:29.931288+0000","last_active":"2024-04-24T02:07:40.134415+0000","last_peered":"2024-04-24T02:07:40.134415+0000","last_clean":"2024-04-24T02:07:40.134415+0000","last_became_active":"2024-04-24T01:54:29.921241+0000","last_became_peered":"2024-04-24T01:54:29.921241+0000","last_unstale":"2024-04-24T02:07:40.134415+0000","last_undegraded":"2024-04-24T02:07:40.134415+0000","last_fullsized":"2024-04-24T02:07:40.134415+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.869045+0000","last_change":"2024-04-24T01:54:29.944487+0000","last_active":"2024-04-24T02:07:39.869045+0000","last_peered":"2024-04-24T02:07:39.869045+0000","last_clean":"2024-04-24T02:07:39.869045+0000","last_became_active":"2024-04-24T01:54:29.929555+0000","last_became_peered":"2024-04-24T01:54:29.929555+0000","last_unstale":"2024-04-24T02:07:39.869045+0000","last_undegraded":"2024-04-24T02:07:39.869045+0000","last_fullsized":"2024-04-24T02:07:39.869045+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.858896+0000","last_change":"2024-04-24T01:54:29.970476+0000","last_active":"2024-04-24T02:07:39.858896+0000","last_peered":"2024-04-24T02:07:39.858896+0000","last_clean":"2024-04-24T02:07:39.858896+0000","last_became_active":"2024-04-24T01:54:29.949994+0000","last_became_peered":"2024-04-24T01:54:29.949994+0000","last_unstale":"2024-04-24T02:07:39.858896+0000","last_undegraded":"2024-04-24T02:07:39.858896+0000","last_fullsized":"2024-04-24T02:07:39.858896+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.898282+0000","last_change":"2024-04-24T01:54:29.978873+0000","last_active":"2024-04-24T02:07:39.898282+0000","last_peered":"2024-04-24T02:07:39.898282+0000","last_clean":"2024-04-24T02:07:39.898282+0000","last_became_active":"2024-04-24T01:54:29.962939+0000","last_became_peered":"2024-04-24T01:54:29.962939+0000","last_unstale":"2024-04-24T02:07:39.898282+0000","last_undegraded":"2024-04-24T02:07:39.898282+0000","last_fullsized":"2024-04-24T02:07:39.898282+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1237,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.121817+0000","last_change":"2024-04-24T01:54:29.967298+0000","last_active":"2024-04-24T02:07:40.121817+0000","last_peered":"2024-04-24T02:07:40.121817+0000","last_clean":"2024-04-24T02:07:40.121817+0000","last_became_active":"2024-04-24T01:54:29.960381+0000","last_became_peered":"2024-04-24T01:54:29.960381+0000","last_unstale":"2024-04-24T02:07:40.121817+0000","last_undegraded":"2024-04-24T02:07:40.121817+0000","last_fullsized":"2024-04-24T02:07:40.121817+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.132185+0000","last_change":"2024-04-24T01:54:29.883604+0000","last_active":"2024-04-24T02:07:40.132185+0000","last_peered":"2024-04-24T02:07:40.132185+0000","last_clean":"2024-04-24T02:07:40.132185+0000","last_became_active":"2024-04-24T01:54:29.874172+0000","last_became_peered":"2024-04-24T01:54:29.874172+0000","last_unstale":"2024-04-24T02:07:40.132185+0000","last_undegraded":"2024-04-24T02:07:40.132185+0000","last_fullsized":"2024-04-24T02:07:40.132185+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1269,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.314904+0000","last_change":"2024-04-24T01:54:29.959775+0000","last_active":"2024-04-24T02:07:40.314904+0000","last_peered":"2024-04-24T02:07:40.314904+0000","last_clean":"2024-04-24T02:07:40.314904+0000","last_became_active":"2024-04-24T01:54:29.950635+0000","last_became_peered":"2024-04-24T01:54:29.950635+0000","last_unstale":"2024-04-24T02:07:40.314904+0000","last_undegraded":"2024-04-24T02:07:40.314904+0000","last_fullsized":"2024-04-24T02:07:40.314904+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1269,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.334948+0000","last_change":"2024-04-24T01:54:29.988510+0000","last_active":"2024-04-24T02:07:40.334948+0000","last_peered":"2024-04-24T02:07:40.334948+0000","last_clean":"2024-04-24T02:07:40.334948+0000","last_became_active":"2024-04-24T01:54:29.981633+0000","last_became_peered":"2024-04-24T01:54:29.981633+0000","last_unstale":"2024-04-24T02:07:40.334948+0000","last_undegraded":"2024-04-24T02:07:40.334948+0000","last_fullsized":"2024-04-24T02:07:40.334948+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1269,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.318876+0000","last_change":"2024-04-24T01:54:29.973040+0000","last_active":"2024-04-24T02:07:40.318876+0000","last_peered":"2024-04-24T02:07:40.318876+0000","last_clean":"2024-04-24T02:07:40.318876+0000","last_became_active":"2024-04-24T01:54:29.963206+0000","last_became_peered":"2024-04-24T01:54:29.963206+0000","last_unstale":"2024-04-24T02:07:40.318876+0000","last_undegraded":"2024-04-24T02:07:40.318876+0000","last_fullsized":"2024-04-24T02:07:40.318876+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.127302+0000","last_change":"2024-04-24T01:54:29.916876+0000","last_active":"2024-04-24T02:07:40.127302+0000","last_peered":"2024-04-24T02:07:40.127302+0000","last_clean":"2024-04-24T02:07:40.127302+0000","last_became_active":"2024-04-24T01:54:29.899615+0000","last_became_peered":"2024-04-24T01:54:29.899615+0000","last_unstale":"2024-04-24T02:07:40.127302+0000","last_undegraded":"2024-04-24T02:07:40.127302+0000","last_fullsized":"2024-04-24T02:07:40.127302+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1237,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.142993+0000","last_change":"2024-04-24T01:54:29.942521+0000","last_active":"2024-04-24T02:07:40.142993+0000","last_peered":"2024-04-24T02:07:40.142993+0000","last_clean":"2024-04-24T02:07:40.142993+0000","last_became_active":"2024-04-24T01:54:29.933820+0000","last_became_peered":"2024-04-24T01:54:29.933820+0000","last_unstale":"2024-04-24T02:07:40.142993+0000","last_undegraded":"2024-04-24T02:07:40.142993+0000","last_fullsized":"2024-04-24T02:07:40.142993+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1237,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.118742+0000","last_change":"2024-04-24T01:54:29.903130+0000","last_active":"2024-04-24T02:07:40.118742+0000","last_peered":"2024-04-24T02:07:40.118742+0000","last_clean":"2024-04-24T02:07:40.118742+0000","last_became_active":"2024-04-24T01:54:29.897105+0000","last_became_peered":"2024-04-24T01:54:29.897105+0000","last_unstale":"2024-04-24T02:07:40.118742+0000","last_undegraded":"2024-04-24T02:07:40.118742+0000","last_fullsized":"2024-04-24T02:07:40.118742+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.883017+0000","last_change":"2024-04-24T01:54:29.935141+0000","last_active":"2024-04-24T02:07:39.883017+0000","last_peered":"2024-04-24T02:07:39.883017+0000","last_clean":"2024-04-24T02:07:39.883017+0000","last_became_active":"2024-04-24T01:54:29.920622+0000","last_became_peered":"2024-04-24T01:54:29.920622+0000","last_unstale":"2024-04-24T02:07:39.883017+0000","last_undegraded":"2024-04-24T02:07:39.883017+0000","last_fullsized":"2024-04-24T02:07:39.883017+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1237,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.131673+0000","last_change":"2024-04-24T01:54:29.954567+0000","last_active":"2024-04-24T02:07:40.131673+0000","last_peered":"2024-04-24T02:07:40.131673+0000","last_clean":"2024-04-24T02:07:40.131673+0000","last_became_active":"2024-04-24T01:54:29.946732+0000","last_became_peered":"2024-04-24T01:54:29.946732+0000","last_unstale":"2024-04-24T02:07:40.131673+0000","last_undegraded":"2024-04-24T02:07:40.131673+0000","last_fullsized":"2024-04-24T02:07:40.131673+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.871567+0000","last_change":"2024-04-24T01:54:30.051664+0000","last_active":"2024-04-24T02:07:39.871567+0000","last_peered":"2024-04-24T02:07:39.871567+0000","last_clean":"2024-04-24T02:07:39.871567+0000","last_became_active":"2024-04-24T01:54:30.037754+0000","last_became_peered":"2024-04-24T01:54:30.037754+0000","last_unstale":"2024-04-24T02:07:39.871567+0000","last_undegraded":"2024-04-24T02:07:39.871567+0000","last_fullsized":"2024-04-24T02:07:39.871567+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.867185+0000","last_change":"2024-04-24T01:54:29.911375+0000","last_active":"2024-04-24T02:07:39.867185+0000","last_peered":"2024-04-24T02:07:39.867185+0000","last_clean":"2024-04-24T02:07:39.867185+0000","last_became_active":"2024-04-24T01:54:29.904467+0000","last_became_peered":"2024-04-24T01:54:29.904467+0000","last_unstale":"2024-04-24T02:07:39.867185+0000","last_undegraded":"2024-04-24T02:07:39.867185+0000","last_fullsized":"2024-04-24T02:07:39.867185+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.904719+0000","last_change":"2024-04-24T01:54:30.026621+0000","last_active":"2024-04-24T02:07:39.904719+0000","last_peered":"2024-04-24T02:07:39.904719+0000","last_clean":"2024-04-24T02:07:39.904719+0000","last_became_active":"2024-04-24T01:54:30.019236+0000","last_became_peered":"2024-04-24T01:54:30.019236+0000","last_unstale":"2024-04-24T02:07:39.904719+0000","last_undegraded":"2024-04-24T02:07:39.904719+0000","last_fullsized":"2024-04-24T02:07:39.904719+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1282,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.328656+0000","last_change":"2024-04-24T01:54:29.879709+0000","last_active":"2024-04-24T02:07:40.328656+0000","last_peered":"2024-04-24T02:07:40.328656+0000","last_clean":"2024-04-24T02:07:40.328656+0000","last_became_active":"2024-04-24T01:54:29.873358+0000","last_became_peered":"2024-04-24T01:54:29.873358+0000","last_unstale":"2024-04-24T02:07:40.328656+0000","last_undegraded":"2024-04-24T02:07:40.328656+0000","last_fullsized":"2024-04-24T02:07:40.328656+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.187754+0000","last_change":"2024-04-24T01:54:29.921138+0000","last_active":"2024-04-24T02:07:40.187754+0000","last_peered":"2024-04-24T02:07:40.187754+0000","last_clean":"2024-04-24T02:07:40.187754+0000","last_became_active":"2024-04-24T01:54:29.909001+0000","last_became_peered":"2024-04-24T01:54:29.909001+0000","last_unstale":"2024-04-24T02:07:40.187754+0000","last_undegraded":"2024-04-24T02:07:40.187754+0000","last_fullsized":"2024-04-24T02:07:40.187754+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1859,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.459062+0000","last_change":"2024-04-24T01:48:40.062414+0000","last_active":"2024-04-24T02:07:40.459062+0000","last_peered":"2024-04-24T02:07:40.459062+0000","last_clean":"2024-04-24T02:07:40.459062+0000","last_became_active":"2024-04-24T01:48:40.055629+0000","last_became_peered":"2024-04-24T01:48:40.055629+0000","last_unstale":"2024-04-24T02:07:40.459062+0000","last_undegraded":"2024-04-24T02:07:40.459062+0000","last_fullsized":"2024-04-24T02:07:40.459062+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1861,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.291589+0000","last_change":"2024-04-24T01:48:40.045311+0000","last_active":"2024-04-24T02:07:40.291589+0000","last_peered":"2024-04-24T02:07:40.291589+0000","last_clean":"2024-04-24T02:07:40.291589+0000","last_became_active":"2024-04-24T01:48:40.041551+0000","last_became_peered":"2024-04-24T01:48:40.041551+0000","last_unstale":"2024-04-24T02:07:40.291589+0000","last_undegraded":"2024-04-24T02:07:40.291589+0000","last_fullsized":"2024-04-24T02:07:40.291589+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1843,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.285912+0000","last_change":"2024-04-24T01:48:40.045108+0000","last_active":"2024-04-24T02:07:40.285912+0000","last_peered":"2024-04-24T02:07:40.285912+0000","last_clean":"2024-04-24T02:07:40.285912+0000","last_became_active":"2024-04-24T01:48:40.038574+0000","last_became_peered":"2024-04-24T01:48:40.038574+0000","last_unstale":"2024-04-24T02:07:40.285912+0000","last_undegraded":"2024-04-24T02:07:40.285912+0000","last_fullsized":"2024-04-24T02:07:40.285912+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1861,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.155215+0000","last_change":"2024-04-24T01:48:40.035237+0000","last_active":"2024-04-24T02:07:40.155215+0000","last_peered":"2024-04-24T02:07:40.155215+0000","last_clean":"2024-04-24T02:07:40.155215+0000","last_became_active":"2024-04-24T01:48:40.030062+0000","last_became_peered":"2024-04-24T01:48:40.030062+0000","last_unstale":"2024-04-24T02:07:40.155215+0000","last_undegraded":"2024-04-24T02:07:40.155215+0000","last_fullsized":"2024-04-24T02:07:40.155215+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1869,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.010295+0000","last_change":"2024-04-24T01:48:40.046631+0000","last_active":"2024-04-24T02:07:40.010295+0000","last_peered":"2024-04-24T02:07:40.010295+0000","last_clean":"2024-04-24T02:07:40.010295+0000","last_became_active":"2024-04-24T01:48:40.040843+0000","last_became_peered":"2024-04-24T01:48:40.040843+0000","last_unstale":"2024-04-24T02:07:40.010295+0000","last_undegraded":"2024-04-24T02:07:40.010295+0000","last_fullsized":"2024-04-24T02:07:40.010295+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1859,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.353868+0000","last_change":"2024-04-24T01:48:40.043159+0000","last_active":"2024-04-24T02:07:40.353868+0000","last_peered":"2024-04-24T02:07:40.353868+0000","last_clean":"2024-04-24T02:07:40.353868+0000","last_became_active":"2024-04-24T01:48:40.033297+0000","last_became_peered":"2024-04-24T01:48:40.033297+0000","last_unstale":"2024-04-24T02:07:40.353868+0000","last_undegraded":"2024-04-24T02:07:40.353868+0000","last_fullsized":"2024-04-24T02:07:40.353868+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1869,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.008819+0000","last_change":"2024-04-24T01:48:40.063620+0000","last_active":"2024-04-24T02:07:40.008819+0000","last_peered":"2024-04-24T02:07:40.008819+0000","last_clean":"2024-04-24T02:07:40.008819+0000","last_became_active":"2024-04-24T01:48:40.054792+0000","last_became_peered":"2024-04-24T01:48:40.054792+0000","last_unstale":"2024-04-24T02:07:40.008819+0000","last_undegraded":"2024-04-24T02:07:40.008819+0000","last_fullsized":"2024-04-24T02:07:40.008819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1859,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.435500+0000","last_change":"2024-04-24T01:48:40.057853+0000","last_active":"2024-04-24T02:07:40.435500+0000","last_peered":"2024-04-24T02:07:40.435500+0000","last_clean":"2024-04-24T02:07:40.435500+0000","last_became_active":"2024-04-24T01:48:40.052084+0000","last_became_peered":"2024-04-24T01:48:40.052084+0000","last_unstale":"2024-04-24T02:07:40.435500+0000","last_undegraded":"2024-04-24T02:07:40.435500+0000","last_fullsized":"2024-04-24T02:07:40.435500+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":1976,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.159792+0000","last_change":"2024-04-24T01:48:38.013745+0000","last_active":"2024-04-24T02:07:40.159792+0000","last_peered":"2024-04-24T02:07:40.159792+0000","last_clean":"2024-04-24T02:07:40.159792+0000","last_became_active":"2024-04-24T01:48:38.008438+0000","last_became_peered":"2024-04-24T01:48:38.008438+0000","last_unstale":"2024-04-24T02:07:40.159792+0000","last_undegraded":"2024-04-24T02:07:40.159792+0000","last_fullsized":"2024-04-24T02:07:40.159792+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:36.956380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:36.956380+0000","last_clean_scrub_stamp":"2024-04-24T01:48:36.956380+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706837,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":67152,"kb_used_data":4104,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":104790448,"statfs":{"total":107374182400,"available":107305418752,"internally_reserved":0,"allocated":4202496,"data_stored":2051882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706837,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":79144,"kb_used_data":3616,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104778456,"statfs":{"total":107374182400,"available":107293138944,"internally_reserved":0,"allocated":3702784,"data_stored":1478912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706837,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":79080,"kb_used_data":3552,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104778520,"statfs":{"total":107374182400,"available":107293204480,"internally_reserved":0,"allocated":3637248,"data_stored":1476802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706837,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":71416,"kb_used_data":4208,"kb_used_omap":0,"kb_used_meta":67200,"kb_avail":104786184,"statfs":{"total":107374182400,"available":107301052416,"internally_reserved":0,"allocated":4308992,"data_stored":2081249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68812800},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T02:08:12.877 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T02:08:12.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.982+0000 7ff1aa0ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:12.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.987+0000 7ff1aa0ad640 1 Processor -- start 2024-04-24T02:08:12.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.987+0000 7ff1aa0ad640 1 -- start start 2024-04-24T02:08:12.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.989+0000 7ff1aa0ad640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff1a409ce30 0x7ff1a4132c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:12.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.989+0000 7ff1aa0ad640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1a409dc80 con 0x7ff1a41331b0 2024-04-24T02:08:12.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.989+0000 7ff1aa0ad640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7ff1a409c440 con 0x7ff1a409ce30 2024-04-24T02:08:12.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.989+0000 7ff1a37fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff1a409ce30 0x7ff1a4132c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:12.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.989+0000 7ff1a2ffd640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff1a41331b0 0x7ff1a40a0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39806/0 (socket says 172.21.15.57:39806) 2024-04-24T02:08:12.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.989+0000 7ff1a2ffd640 1 -- 172.21.15.57:0/947684570 learned_addr learned my addr 172.21.15.57:0/947684570 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T02:08:12.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.989+0000 7ff1a37fe640 1 -- 172.21.15.57:0/947684570 >> v1:172.21.15.57:6789/0 conn(0x7ff1a41331b0 legacy=0x7ff1a40a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:12.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.989+0000 7ff1a37fe640 1 -- 172.21.15.57:0/947684570 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a4132840 con 0x7ff1a409ce30 2024-04-24T02:08:12.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.990+0000 7ff1a37fe640 1 --2- 172.21.15.57:0/947684570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1a409ce30 0x7ff1a4132c70 crc :-1 s=READY pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33465087cdb428e server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:12.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.990+0000 7ff1a27fc640 1 -- 172.21.15.57:0/947684570 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff194009d90 con 0x7ff1a409ce30 2024-04-24T02:08:12.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.990+0000 7ff1a27fc640 1 -- 172.21.15.57:0/947684570 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff19400e230 con 0x7ff1a409ce30 2024-04-24T02:08:12.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.990+0000 7ff1a27fc640 1 -- 172.21.15.57:0/947684570 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff19400e4d0 con 0x7ff1a409ce30 2024-04-24T02:08:12.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.990+0000 7ff1aa0ad640 1 -- 172.21.15.57:0/947684570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1a409ce30 msgr2=0x7ff1a4132c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:12.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.990+0000 7ff1aa0ad640 1 --2- 172.21.15.57:0/947684570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1a409ce30 0x7ff1a4132c70 crc :-1 s=READY pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:12.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.990+0000 7ff1aa0ad640 1 -- 172.21.15.57:0/947684570 shutdown_connections 2024-04-24T02:08:12.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.990+0000 7ff1aa0ad640 1 --2- 172.21.15.57:0/947684570 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1a409ce30 0x7ff1a4132c70 unknown :-1 s=CLOSED pgs=12967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:12.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.990+0000 7ff1aa0ad640 1 -- 172.21.15.57:0/947684570 >> 172.21.15.57:0/947684570 conn(0x7ff1a409aa00 msgr2=0x7ff1a409ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:12.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.991+0000 7ff1aa0ad640 1 -- 172.21.15.57:0/947684570 shutdown_connections 2024-04-24T02:08:12.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.991+0000 7ff1aa0ad640 1 -- 172.21.15.57:0/947684570 wait complete. 2024-04-24T02:08:12.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.991+0000 7ff1aa0ad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:12.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.992+0000 7ff1aa0ad640 1 Processor -- start 2024-04-24T02:08:12.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.993+0000 7ff1aa0ad640 1 -- start start 2024-04-24T02:08:12.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.994+0000 7ff1aa0ad640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1a409ce30 0x7ff1a406d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:12.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.994+0000 7ff1aa0ad640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a4123ce0 con 0x7ff1a409ce30 2024-04-24T02:08:12.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.995+0000 7ff1a37fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1a409ce30 0x7ff1a406d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:12.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.995+0000 7ff1a37fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1a409ce30 0x7ff1a406d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51692/0 (socket says 172.21.15.57:51692) 2024-04-24T02:08:12.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.995+0000 7ff1a37fe640 1 -- 172.21.15.57:0/1164908898 learned_addr learned my addr 172.21.15.57:0/1164908898 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:08:12.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.995+0000 7ff1a37fe640 1 -- 172.21.15.57:0/1164908898 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a4123f10 con 0x7ff1a409ce30 2024-04-24T02:08:12.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.995+0000 7ff1a37fe640 1 --2- 172.21.15.57:0/1164908898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1a409ce30 0x7ff1a406d970 crc :-1 s=READY pgs=12968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:12.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.995+0000 7ff18bfff640 1 -- 172.21.15.57:0/1164908898 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff194013530 con 0x7ff1a409ce30 2024-04-24T02:08:12.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.995+0000 7ff18bfff640 1 -- 172.21.15.57:0/1164908898 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7ff194013690 con 0x7ff1a409ce30 2024-04-24T02:08:12.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.995+0000 7ff1aa0ad640 1 -- 172.21.15.57:0/1164908898 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1a4124450 con 0x7ff1a409ce30 2024-04-24T02:08:12.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.995+0000 7ff18bfff640 1 -- 172.21.15.57:0/1164908898 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7ff194013930 con 0x7ff1a409ce30 2024-04-24T02:08:12.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.995+0000 7ff1aa0ad640 1 -- 172.21.15.57:0/1164908898 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1a41301c0 con 0x7ff1a409ce30 2024-04-24T02:08:12.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.996+0000 7ff18bfff640 1 -- 172.21.15.57:0/1164908898 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7ff194013ae0 con 0x7ff1a409ce30 2024-04-24T02:08:12.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.996+0000 7ff1aa0ad640 1 -- 172.21.15.57:0/1164908898 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1a4125160 con 0x7ff1a409ce30 2024-04-24T02:08:12.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.997+0000 7ff18bfff640 1 --2- 172.21.15.57:0/1164908898 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7ff190038980 0x7ff19003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:12.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.997+0000 7ff18bfff640 1 -- 172.21.15.57:0/1164908898 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(714..714 src has 395..714) ==== 3403+0+0 (crc 0 0 0) 0x7ff194018040 con 0x7ff1a409ce30 2024-04-24T02:08:12.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.997+0000 7ff1a2ffd640 1 --2- 172.21.15.57:0/1164908898 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7ff190038980 0x7ff19003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:12.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:12.998+0000 7ff1a2ffd640 1 --2- 172.21.15.57:0/1164908898 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7ff190038980 0x7ff19003ae90 crc :-1 s=READY pgs=3959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:13.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.002+0000 7ff18bfff640 1 -- 172.21.15.57:0/1164908898 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7ff194017190 con 0x7ff1a409ce30 2024-04-24T02:08:13.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.185+0000 7ff1aa0ad640 1 -- 172.21.15.57:0/1164908898 --> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff1a4125390 con 0x7ff190038980 2024-04-24T02:08:13.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.189+0000 7ff18bfff640 1 -- 172.21.15.57:0/1164908898 <== mgr.4101 v2:172.21.15.84:6800/1747524692 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109148 (crc 0 0 0) 0x7ff198001250 con 0x7ff190038980 2024-04-24T02:08:13.190 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T02:08:13.191 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-24T02:08:13.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.191+0000 7ff1aa0ad640 1 -- 172.21.15.57:0/1164908898 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7ff190038980 msgr2=0x7ff19003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:13.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.191+0000 7ff1aa0ad640 1 --2- 172.21.15.57:0/1164908898 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7ff190038980 0x7ff19003ae90 crc :-1 s=READY pgs=3959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:13.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.191+0000 7ff1aa0ad640 1 -- 172.21.15.57:0/1164908898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1a409ce30 msgr2=0x7ff1a406d970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:13.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.191+0000 7ff1aa0ad640 1 --2- 172.21.15.57:0/1164908898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1a409ce30 0x7ff1a406d970 crc :-1 s=READY pgs=12968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:13.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.191+0000 7ff1aa0ad640 1 -- 172.21.15.57:0/1164908898 shutdown_connections 2024-04-24T02:08:13.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.191+0000 7ff1aa0ad640 1 --2- 172.21.15.57:0/1164908898 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7ff190038980 0x7ff19003ae90 unknown :-1 s=CLOSED pgs=3959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:13.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.191+0000 7ff1aa0ad640 1 --2- 172.21.15.57:0/1164908898 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff1a409ce30 0x7ff1a406d970 unknown :-1 s=CLOSED pgs=12968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:13.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.191+0000 7ff1aa0ad640 1 -- 172.21.15.57:0/1164908898 >> 172.21.15.57:0/1164908898 conn(0x7ff1a409aa00 msgr2=0x7ff1a40708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:13.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.191+0000 7ff1aa0ad640 1 -- 172.21.15.57:0/1164908898 shutdown_connections 2024-04-24T02:08:13.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.191+0000 7ff1aa0ad640 1 -- 172.21.15.57:0/1164908898 wait complete. 2024-04-24T02:08:13.204 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":1295,"stamp":"2024-04-24T02:08:11.868848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590373,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":97,"num_write":144,"num_write_kb":1901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":296792,"kb_used_data":15480,"kb_used_omap":0,"kb_used_meta":281280,"kb_avail":419133608,"statfs":{"total":429496729600,"available":429192814592,"internally_reserved":0,"allocated":15851520,"data_stored":7088845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":288030720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-296900,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.675156"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1269,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.324677+0000","last_change":"2024-04-24T01:54:29.908821+0000","last_active":"2024-04-24T02:07:40.324677+0000","last_peered":"2024-04-24T02:07:40.324677+0000","last_clean":"2024-04-24T02:07:40.324677+0000","last_became_active":"2024-04-24T01:54:29.899903+0000","last_became_peered":"2024-04-24T01:54:29.899903+0000","last_unstale":"2024-04-24T02:07:40.324677+0000","last_undegraded":"2024-04-24T02:07:40.324677+0000","last_fullsized":"2024-04-24T02:07:40.324677+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.857268+0000","last_change":"2024-04-24T01:54:29.967629+0000","last_active":"2024-04-24T02:07:39.857268+0000","last_peered":"2024-04-24T02:07:39.857268+0000","last_clean":"2024-04-24T02:07:39.857268+0000","last_became_active":"2024-04-24T01:54:29.955445+0000","last_became_peered":"2024-04-24T01:54:29.955445+0000","last_unstale":"2024-04-24T02:07:39.857268+0000","last_undegraded":"2024-04-24T02:07:39.857268+0000","last_fullsized":"2024-04-24T02:07:39.857268+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.144489+0000","last_change":"2024-04-24T01:54:29.885625+0000","last_active":"2024-04-24T02:07:40.144489+0000","last_peered":"2024-04-24T02:07:40.144489+0000","last_clean":"2024-04-24T02:07:40.144489+0000","last_became_active":"2024-04-24T01:54:29.877273+0000","last_became_peered":"2024-04-24T01:54:29.877273+0000","last_unstale":"2024-04-24T02:07:40.144489+0000","last_undegraded":"2024-04-24T02:07:40.144489+0000","last_fullsized":"2024-04-24T02:07:40.144489+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1237,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.160927+0000","last_change":"2024-04-24T01:54:29.885696+0000","last_active":"2024-04-24T02:07:40.160927+0000","last_peered":"2024-04-24T02:07:40.160927+0000","last_clean":"2024-04-24T02:07:40.160927+0000","last_became_active":"2024-04-24T01:54:29.878778+0000","last_became_peered":"2024-04-24T01:54:29.878778+0000","last_unstale":"2024-04-24T02:07:40.160927+0000","last_undegraded":"2024-04-24T02:07:40.160927+0000","last_fullsized":"2024-04-24T02:07:40.160927+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1269,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.339109+0000","last_change":"2024-04-24T01:54:29.953603+0000","last_active":"2024-04-24T02:07:40.339109+0000","last_peered":"2024-04-24T02:07:40.339109+0000","last_clean":"2024-04-24T02:07:40.339109+0000","last_became_active":"2024-04-24T01:54:29.938885+0000","last_became_peered":"2024-04-24T01:54:29.938885+0000","last_unstale":"2024-04-24T02:07:40.339109+0000","last_undegraded":"2024-04-24T02:07:40.339109+0000","last_fullsized":"2024-04-24T02:07:40.339109+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.812793+0000","last_change":"2024-04-24T01:54:29.937576+0000","last_active":"2024-04-24T02:07:39.812793+0000","last_peered":"2024-04-24T02:07:39.812793+0000","last_clean":"2024-04-24T02:07:39.812793+0000","last_became_active":"2024-04-24T01:54:29.925475+0000","last_became_peered":"2024-04-24T01:54:29.925475+0000","last_unstale":"2024-04-24T02:07:39.812793+0000","last_undegraded":"2024-04-24T02:07:39.812793+0000","last_fullsized":"2024-04-24T02:07:39.812793+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.866141+0000","last_change":"2024-04-24T01:54:30.009375+0000","last_active":"2024-04-24T02:07:39.866141+0000","last_peered":"2024-04-24T02:07:39.866141+0000","last_clean":"2024-04-24T02:07:39.866141+0000","last_became_active":"2024-04-24T01:54:30.002762+0000","last_became_peered":"2024-04-24T01:54:30.002762+0000","last_unstale":"2024-04-24T02:07:39.866141+0000","last_undegraded":"2024-04-24T02:07:39.866141+0000","last_fullsized":"2024-04-24T02:07:39.866141+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.886419+0000","last_change":"2024-04-24T01:54:29.958936+0000","last_active":"2024-04-24T02:07:39.886419+0000","last_peered":"2024-04-24T02:07:39.886419+0000","last_clean":"2024-04-24T02:07:39.886419+0000","last_became_active":"2024-04-24T01:54:29.940930+0000","last_became_peered":"2024-04-24T01:54:29.940930+0000","last_unstale":"2024-04-24T02:07:39.886419+0000","last_undegraded":"2024-04-24T02:07:39.886419+0000","last_fullsized":"2024-04-24T02:07:39.886419+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1237,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.169469+0000","last_change":"2024-04-24T01:54:29.927605+0000","last_active":"2024-04-24T02:07:40.169469+0000","last_peered":"2024-04-24T02:07:40.169469+0000","last_clean":"2024-04-24T02:07:40.169469+0000","last_became_active":"2024-04-24T01:54:29.915996+0000","last_became_peered":"2024-04-24T01:54:29.915996+0000","last_unstale":"2024-04-24T02:07:40.169469+0000","last_undegraded":"2024-04-24T02:07:40.169469+0000","last_fullsized":"2024-04-24T02:07:40.169469+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.158355+0000","last_change":"2024-04-24T01:54:29.937993+0000","last_active":"2024-04-24T02:07:40.158355+0000","last_peered":"2024-04-24T02:07:40.158355+0000","last_clean":"2024-04-24T02:07:40.158355+0000","last_became_active":"2024-04-24T01:54:29.932001+0000","last_became_peered":"2024-04-24T01:54:29.932001+0000","last_unstale":"2024-04-24T02:07:40.158355+0000","last_undegraded":"2024-04-24T02:07:40.158355+0000","last_fullsized":"2024-04-24T02:07:40.158355+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1237,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.114455+0000","last_change":"2024-04-24T01:54:29.983449+0000","last_active":"2024-04-24T02:07:40.114455+0000","last_peered":"2024-04-24T02:07:40.114455+0000","last_clean":"2024-04-24T02:07:40.114455+0000","last_became_active":"2024-04-24T01:54:29.977785+0000","last_became_peered":"2024-04-24T01:54:29.977785+0000","last_unstale":"2024-04-24T02:07:40.114455+0000","last_undegraded":"2024-04-24T02:07:40.114455+0000","last_fullsized":"2024-04-24T02:07:40.114455+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.892640+0000","last_change":"2024-04-24T01:54:29.984917+0000","last_active":"2024-04-24T02:07:39.892640+0000","last_peered":"2024-04-24T02:07:39.892640+0000","last_clean":"2024-04-24T02:07:39.892640+0000","last_became_active":"2024-04-24T01:54:29.974222+0000","last_became_peered":"2024-04-24T01:54:29.974222+0000","last_unstale":"2024-04-24T02:07:39.892640+0000","last_undegraded":"2024-04-24T02:07:39.892640+0000","last_fullsized":"2024-04-24T02:07:39.892640+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1237,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.102021+0000","last_change":"2024-04-24T01:54:30.012455+0000","last_active":"2024-04-24T02:07:40.102021+0000","last_peered":"2024-04-24T02:07:40.102021+0000","last_clean":"2024-04-24T02:07:40.102021+0000","last_became_active":"2024-04-24T01:54:30.006792+0000","last_became_peered":"2024-04-24T01:54:30.006792+0000","last_unstale":"2024-04-24T02:07:40.102021+0000","last_undegraded":"2024-04-24T02:07:40.102021+0000","last_fullsized":"2024-04-24T02:07:40.102021+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1237,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.134415+0000","last_change":"2024-04-24T01:54:29.931288+0000","last_active":"2024-04-24T02:07:40.134415+0000","last_peered":"2024-04-24T02:07:40.134415+0000","last_clean":"2024-04-24T02:07:40.134415+0000","last_became_active":"2024-04-24T01:54:29.921241+0000","last_became_peered":"2024-04-24T01:54:29.921241+0000","last_unstale":"2024-04-24T02:07:40.134415+0000","last_undegraded":"2024-04-24T02:07:40.134415+0000","last_fullsized":"2024-04-24T02:07:40.134415+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.869045+0000","last_change":"2024-04-24T01:54:29.944487+0000","last_active":"2024-04-24T02:07:39.869045+0000","last_peered":"2024-04-24T02:07:39.869045+0000","last_clean":"2024-04-24T02:07:39.869045+0000","last_became_active":"2024-04-24T01:54:29.929555+0000","last_became_peered":"2024-04-24T01:54:29.929555+0000","last_unstale":"2024-04-24T02:07:39.869045+0000","last_undegraded":"2024-04-24T02:07:39.869045+0000","last_fullsized":"2024-04-24T02:07:39.869045+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.858896+0000","last_change":"2024-04-24T01:54:29.970476+0000","last_active":"2024-04-24T02:07:39.858896+0000","last_peered":"2024-04-24T02:07:39.858896+0000","last_clean":"2024-04-24T02:07:39.858896+0000","last_became_active":"2024-04-24T01:54:29.949994+0000","last_became_peered":"2024-04-24T01:54:29.949994+0000","last_unstale":"2024-04-24T02:07:39.858896+0000","last_undegraded":"2024-04-24T02:07:39.858896+0000","last_fullsized":"2024-04-24T02:07:39.858896+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.898282+0000","last_change":"2024-04-24T01:54:29.978873+0000","last_active":"2024-04-24T02:07:39.898282+0000","last_peered":"2024-04-24T02:07:39.898282+0000","last_clean":"2024-04-24T02:07:39.898282+0000","last_became_active":"2024-04-24T01:54:29.962939+0000","last_became_peered":"2024-04-24T01:54:29.962939+0000","last_unstale":"2024-04-24T02:07:39.898282+0000","last_undegraded":"2024-04-24T02:07:39.898282+0000","last_fullsized":"2024-04-24T02:07:39.898282+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1237,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.121817+0000","last_change":"2024-04-24T01:54:29.967298+0000","last_active":"2024-04-24T02:07:40.121817+0000","last_peered":"2024-04-24T02:07:40.121817+0000","last_clean":"2024-04-24T02:07:40.121817+0000","last_became_active":"2024-04-24T01:54:29.960381+0000","last_became_peered":"2024-04-24T01:54:29.960381+0000","last_unstale":"2024-04-24T02:07:40.121817+0000","last_undegraded":"2024-04-24T02:07:40.121817+0000","last_fullsized":"2024-04-24T02:07:40.121817+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.132185+0000","last_change":"2024-04-24T01:54:29.883604+0000","last_active":"2024-04-24T02:07:40.132185+0000","last_peered":"2024-04-24T02:07:40.132185+0000","last_clean":"2024-04-24T02:07:40.132185+0000","last_became_active":"2024-04-24T01:54:29.874172+0000","last_became_peered":"2024-04-24T01:54:29.874172+0000","last_unstale":"2024-04-24T02:07:40.132185+0000","last_undegraded":"2024-04-24T02:07:40.132185+0000","last_fullsized":"2024-04-24T02:07:40.132185+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1269,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.314904+0000","last_change":"2024-04-24T01:54:29.959775+0000","last_active":"2024-04-24T02:07:40.314904+0000","last_peered":"2024-04-24T02:07:40.314904+0000","last_clean":"2024-04-24T02:07:40.314904+0000","last_became_active":"2024-04-24T01:54:29.950635+0000","last_became_peered":"2024-04-24T01:54:29.950635+0000","last_unstale":"2024-04-24T02:07:40.314904+0000","last_undegraded":"2024-04-24T02:07:40.314904+0000","last_fullsized":"2024-04-24T02:07:40.314904+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1269,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.334948+0000","last_change":"2024-04-24T01:54:29.988510+0000","last_active":"2024-04-24T02:07:40.334948+0000","last_peered":"2024-04-24T02:07:40.334948+0000","last_clean":"2024-04-24T02:07:40.334948+0000","last_became_active":"2024-04-24T01:54:29.981633+0000","last_became_peered":"2024-04-24T01:54:29.981633+0000","last_unstale":"2024-04-24T02:07:40.334948+0000","last_undegraded":"2024-04-24T02:07:40.334948+0000","last_fullsized":"2024-04-24T02:07:40.334948+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1269,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.318876+0000","last_change":"2024-04-24T01:54:29.973040+0000","last_active":"2024-04-24T02:07:40.318876+0000","last_peered":"2024-04-24T02:07:40.318876+0000","last_clean":"2024-04-24T02:07:40.318876+0000","last_became_active":"2024-04-24T01:54:29.963206+0000","last_became_peered":"2024-04-24T01:54:29.963206+0000","last_unstale":"2024-04-24T02:07:40.318876+0000","last_undegraded":"2024-04-24T02:07:40.318876+0000","last_fullsized":"2024-04-24T02:07:40.318876+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.127302+0000","last_change":"2024-04-24T01:54:29.916876+0000","last_active":"2024-04-24T02:07:40.127302+0000","last_peered":"2024-04-24T02:07:40.127302+0000","last_clean":"2024-04-24T02:07:40.127302+0000","last_became_active":"2024-04-24T01:54:29.899615+0000","last_became_peered":"2024-04-24T01:54:29.899615+0000","last_unstale":"2024-04-24T02:07:40.127302+0000","last_undegraded":"2024-04-24T02:07:40.127302+0000","last_fullsized":"2024-04-24T02:07:40.127302+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1237,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.142993+0000","last_change":"2024-04-24T01:54:29.942521+0000","last_active":"2024-04-24T02:07:40.142993+0000","last_peered":"2024-04-24T02:07:40.142993+0000","last_clean":"2024-04-24T02:07:40.142993+0000","last_became_active":"2024-04-24T01:54:29.933820+0000","last_became_peered":"2024-04-24T01:54:29.933820+0000","last_unstale":"2024-04-24T02:07:40.142993+0000","last_undegraded":"2024-04-24T02:07:40.142993+0000","last_fullsized":"2024-04-24T02:07:40.142993+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1237,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.118742+0000","last_change":"2024-04-24T01:54:29.903130+0000","last_active":"2024-04-24T02:07:40.118742+0000","last_peered":"2024-04-24T02:07:40.118742+0000","last_clean":"2024-04-24T02:07:40.118742+0000","last_became_active":"2024-04-24T01:54:29.897105+0000","last_became_peered":"2024-04-24T01:54:29.897105+0000","last_unstale":"2024-04-24T02:07:40.118742+0000","last_undegraded":"2024-04-24T02:07:40.118742+0000","last_fullsized":"2024-04-24T02:07:40.118742+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.883017+0000","last_change":"2024-04-24T01:54:29.935141+0000","last_active":"2024-04-24T02:07:39.883017+0000","last_peered":"2024-04-24T02:07:39.883017+0000","last_clean":"2024-04-24T02:07:39.883017+0000","last_became_active":"2024-04-24T01:54:29.920622+0000","last_became_peered":"2024-04-24T01:54:29.920622+0000","last_unstale":"2024-04-24T02:07:39.883017+0000","last_undegraded":"2024-04-24T02:07:39.883017+0000","last_fullsized":"2024-04-24T02:07:39.883017+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1237,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.131673+0000","last_change":"2024-04-24T01:54:29.954567+0000","last_active":"2024-04-24T02:07:40.131673+0000","last_peered":"2024-04-24T02:07:40.131673+0000","last_clean":"2024-04-24T02:07:40.131673+0000","last_became_active":"2024-04-24T01:54:29.946732+0000","last_became_peered":"2024-04-24T01:54:29.946732+0000","last_unstale":"2024-04-24T02:07:40.131673+0000","last_undegraded":"2024-04-24T02:07:40.131673+0000","last_fullsized":"2024-04-24T02:07:40.131673+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.871567+0000","last_change":"2024-04-24T01:54:30.051664+0000","last_active":"2024-04-24T02:07:39.871567+0000","last_peered":"2024-04-24T02:07:39.871567+0000","last_clean":"2024-04-24T02:07:39.871567+0000","last_became_active":"2024-04-24T01:54:30.037754+0000","last_became_peered":"2024-04-24T01:54:30.037754+0000","last_unstale":"2024-04-24T02:07:39.871567+0000","last_undegraded":"2024-04-24T02:07:39.871567+0000","last_fullsized":"2024-04-24T02:07:39.871567+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.867185+0000","last_change":"2024-04-24T01:54:29.911375+0000","last_active":"2024-04-24T02:07:39.867185+0000","last_peered":"2024-04-24T02:07:39.867185+0000","last_clean":"2024-04-24T02:07:39.867185+0000","last_became_active":"2024-04-24T01:54:29.904467+0000","last_became_peered":"2024-04-24T01:54:29.904467+0000","last_unstale":"2024-04-24T02:07:39.867185+0000","last_undegraded":"2024-04-24T02:07:39.867185+0000","last_fullsized":"2024-04-24T02:07:39.867185+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.904719+0000","last_change":"2024-04-24T01:54:30.026621+0000","last_active":"2024-04-24T02:07:39.904719+0000","last_peered":"2024-04-24T02:07:39.904719+0000","last_clean":"2024-04-24T02:07:39.904719+0000","last_became_active":"2024-04-24T01:54:30.019236+0000","last_became_peered":"2024-04-24T01:54:30.019236+0000","last_unstale":"2024-04-24T02:07:39.904719+0000","last_undegraded":"2024-04-24T02:07:39.904719+0000","last_fullsized":"2024-04-24T02:07:39.904719+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1282,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.328656+0000","last_change":"2024-04-24T01:54:29.879709+0000","last_active":"2024-04-24T02:07:40.328656+0000","last_peered":"2024-04-24T02:07:40.328656+0000","last_clean":"2024-04-24T02:07:40.328656+0000","last_became_active":"2024-04-24T01:54:29.873358+0000","last_became_peered":"2024-04-24T01:54:29.873358+0000","last_unstale":"2024-04-24T02:07:40.328656+0000","last_undegraded":"2024-04-24T02:07:40.328656+0000","last_fullsized":"2024-04-24T02:07:40.328656+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.187754+0000","last_change":"2024-04-24T01:54:29.921138+0000","last_active":"2024-04-24T02:07:40.187754+0000","last_peered":"2024-04-24T02:07:40.187754+0000","last_clean":"2024-04-24T02:07:40.187754+0000","last_became_active":"2024-04-24T01:54:29.909001+0000","last_became_peered":"2024-04-24T01:54:29.909001+0000","last_unstale":"2024-04-24T02:07:40.187754+0000","last_undegraded":"2024-04-24T02:07:40.187754+0000","last_fullsized":"2024-04-24T02:07:40.187754+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1859,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.459062+0000","last_change":"2024-04-24T01:48:40.062414+0000","last_active":"2024-04-24T02:07:40.459062+0000","last_peered":"2024-04-24T02:07:40.459062+0000","last_clean":"2024-04-24T02:07:40.459062+0000","last_became_active":"2024-04-24T01:48:40.055629+0000","last_became_peered":"2024-04-24T01:48:40.055629+0000","last_unstale":"2024-04-24T02:07:40.459062+0000","last_undegraded":"2024-04-24T02:07:40.459062+0000","last_fullsized":"2024-04-24T02:07:40.459062+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1861,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.291589+0000","last_change":"2024-04-24T01:48:40.045311+0000","last_active":"2024-04-24T02:07:40.291589+0000","last_peered":"2024-04-24T02:07:40.291589+0000","last_clean":"2024-04-24T02:07:40.291589+0000","last_became_active":"2024-04-24T01:48:40.041551+0000","last_became_peered":"2024-04-24T01:48:40.041551+0000","last_unstale":"2024-04-24T02:07:40.291589+0000","last_undegraded":"2024-04-24T02:07:40.291589+0000","last_fullsized":"2024-04-24T02:07:40.291589+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1843,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.285912+0000","last_change":"2024-04-24T01:48:40.045108+0000","last_active":"2024-04-24T02:07:40.285912+0000","last_peered":"2024-04-24T02:07:40.285912+0000","last_clean":"2024-04-24T02:07:40.285912+0000","last_became_active":"2024-04-24T01:48:40.038574+0000","last_became_peered":"2024-04-24T01:48:40.038574+0000","last_unstale":"2024-04-24T02:07:40.285912+0000","last_undegraded":"2024-04-24T02:07:40.285912+0000","last_fullsized":"2024-04-24T02:07:40.285912+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1861,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.155215+0000","last_change":"2024-04-24T01:48:40.035237+0000","last_active":"2024-04-24T02:07:40.155215+0000","last_peered":"2024-04-24T02:07:40.155215+0000","last_clean":"2024-04-24T02:07:40.155215+0000","last_became_active":"2024-04-24T01:48:40.030062+0000","last_became_peered":"2024-04-24T01:48:40.030062+0000","last_unstale":"2024-04-24T02:07:40.155215+0000","last_undegraded":"2024-04-24T02:07:40.155215+0000","last_fullsized":"2024-04-24T02:07:40.155215+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1869,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.010295+0000","last_change":"2024-04-24T01:48:40.046631+0000","last_active":"2024-04-24T02:07:40.010295+0000","last_peered":"2024-04-24T02:07:40.010295+0000","last_clean":"2024-04-24T02:07:40.010295+0000","last_became_active":"2024-04-24T01:48:40.040843+0000","last_became_peered":"2024-04-24T01:48:40.040843+0000","last_unstale":"2024-04-24T02:07:40.010295+0000","last_undegraded":"2024-04-24T02:07:40.010295+0000","last_fullsized":"2024-04-24T02:07:40.010295+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1859,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.353868+0000","last_change":"2024-04-24T01:48:40.043159+0000","last_active":"2024-04-24T02:07:40.353868+0000","last_peered":"2024-04-24T02:07:40.353868+0000","last_clean":"2024-04-24T02:07:40.353868+0000","last_became_active":"2024-04-24T01:48:40.033297+0000","last_became_peered":"2024-04-24T01:48:40.033297+0000","last_unstale":"2024-04-24T02:07:40.353868+0000","last_undegraded":"2024-04-24T02:07:40.353868+0000","last_fullsized":"2024-04-24T02:07:40.353868+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1869,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.008819+0000","last_change":"2024-04-24T01:48:40.063620+0000","last_active":"2024-04-24T02:07:40.008819+0000","last_peered":"2024-04-24T02:07:40.008819+0000","last_clean":"2024-04-24T02:07:40.008819+0000","last_became_active":"2024-04-24T01:48:40.054792+0000","last_became_peered":"2024-04-24T01:48:40.054792+0000","last_unstale":"2024-04-24T02:07:40.008819+0000","last_undegraded":"2024-04-24T02:07:40.008819+0000","last_fullsized":"2024-04-24T02:07:40.008819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1859,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.435500+0000","last_change":"2024-04-24T01:48:40.057853+0000","last_active":"2024-04-24T02:07:40.435500+0000","last_peered":"2024-04-24T02:07:40.435500+0000","last_clean":"2024-04-24T02:07:40.435500+0000","last_became_active":"2024-04-24T01:48:40.052084+0000","last_became_peered":"2024-04-24T01:48:40.052084+0000","last_unstale":"2024-04-24T02:07:40.435500+0000","last_undegraded":"2024-04-24T02:07:40.435500+0000","last_fullsized":"2024-04-24T02:07:40.435500+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":1976,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.159792+0000","last_change":"2024-04-24T01:48:38.013745+0000","last_active":"2024-04-24T02:07:40.159792+0000","last_peered":"2024-04-24T02:07:40.159792+0000","last_clean":"2024-04-24T02:07:40.159792+0000","last_became_active":"2024-04-24T01:48:38.008438+0000","last_became_peered":"2024-04-24T01:48:38.008438+0000","last_unstale":"2024-04-24T02:07:40.159792+0000","last_undegraded":"2024-04-24T02:07:40.159792+0000","last_fullsized":"2024-04-24T02:07:40.159792+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:36.956380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:36.956380+0000","last_clean_scrub_stamp":"2024-04-24T01:48:36.956380+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706837,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":67152,"kb_used_data":4104,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":104790448,"statfs":{"total":107374182400,"available":107305418752,"internally_reserved":0,"allocated":4202496,"data_stored":2051882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706837,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":79144,"kb_used_data":3616,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104778456,"statfs":{"total":107374182400,"available":107293138944,"internally_reserved":0,"allocated":3702784,"data_stored":1478912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706837,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":79080,"kb_used_data":3552,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104778520,"statfs":{"total":107374182400,"available":107293204480,"internally_reserved":0,"allocated":3637248,"data_stored":1476802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706837,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":71416,"kb_used_data":4208,"kb_used_omap":0,"kb_used_meta":67200,"kb_avail":104786184,"statfs":{"total":107374182400,"available":107301052416,"internally_reserved":0,"allocated":4308992,"data_stored":2081249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68812800},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T02:08:13.207 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-24T02:08:13.208 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T02:08:13.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.315+0000 7f07b039d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:13.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.320+0000 7f07b039d640 1 Processor -- start 2024-04-24T02:08:13.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.320+0000 7f07b039d640 1 -- start start 2024-04-24T02:08:13.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.322+0000 7f07b039d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f07a809ce30 0x7f07a8132c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:13.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.322+0000 7f07b039d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07a809dc80 con 0x7f07a81331b0 2024-04-24T02:08:13.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.322+0000 7f07b039d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f07a809c440 con 0x7f07a809ce30 2024-04-24T02:08:13.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.322+0000 7f07ae139640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f07a809ce30 0x7f07a8132c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:13.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.322+0000 7f07ad938640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f07a81331b0 0x7f07a80a0630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39810/0 (socket says 172.21.15.57:39810) 2024-04-24T02:08:13.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.322+0000 7f07ad938640 1 -- 172.21.15.57:0/338698271 learned_addr learned my addr 172.21.15.57:0/338698271 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T02:08:13.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.322+0000 7f07ae139640 1 -- 172.21.15.57:0/338698271 >> v1:172.21.15.57:6789/0 conn(0x7f07a81331b0 legacy=0x7f07a80a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:13.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.322+0000 7f07ae139640 1 -- 172.21.15.57:0/338698271 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07a8132840 con 0x7f07a809ce30 2024-04-24T02:08:13.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.322+0000 7f07ad137640 1 -- 172.21.15.57:0/338698271 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4286807662 0 0) 0x7f07a809dc80 con 0x7f07a81331b0 2024-04-24T02:08:13.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.322+0000 7f07ae139640 1 --2- 172.21.15.57:0/338698271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07a809ce30 0x7f07a8132c70 crc :-1 s=READY pgs=12970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=508cfee4ef32366b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:13.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.322+0000 7f07ad137640 1 -- 172.21.15.57:0/338698271 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f07a4009d90 con 0x7f07a809ce30 2024-04-24T02:08:13.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.323+0000 7f07ad137640 1 -- 172.21.15.57:0/338698271 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f07a400e230 con 0x7f07a809ce30 2024-04-24T02:08:13.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.323+0000 7f07ad137640 1 -- 172.21.15.57:0/338698271 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f07a400e4d0 con 0x7f07a809ce30 2024-04-24T02:08:13.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.323+0000 7f07b039d640 1 -- 172.21.15.57:0/338698271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07a809ce30 msgr2=0x7f07a8132c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:13.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.323+0000 7f07b039d640 1 --2- 172.21.15.57:0/338698271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07a809ce30 0x7f07a8132c70 crc :-1 s=READY pgs=12970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:13.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.323+0000 7f07b039d640 1 -- 172.21.15.57:0/338698271 shutdown_connections 2024-04-24T02:08:13.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.323+0000 7f07b039d640 1 --2- 172.21.15.57:0/338698271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07a809ce30 0x7f07a8132c70 unknown :-1 s=CLOSED pgs=12970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:13.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.323+0000 7f07b039d640 1 -- 172.21.15.57:0/338698271 >> 172.21.15.57:0/338698271 conn(0x7f07a809aa00 msgr2=0x7f07a809ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:13.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.323+0000 7f07b039d640 1 -- 172.21.15.57:0/338698271 shutdown_connections 2024-04-24T02:08:13.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.323+0000 7f07b039d640 1 -- 172.21.15.57:0/338698271 wait complete. 2024-04-24T02:08:13.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.324+0000 7f07b039d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:13.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.325+0000 7f07b039d640 1 Processor -- start 2024-04-24T02:08:13.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.325+0000 7f07b039d640 1 -- start start 2024-04-24T02:08:13.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.327+0000 7f07b039d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07a809ce30 0x7f07a811ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:13.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.327+0000 7f07b039d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f07a8130010 con 0x7f07a809ce30 2024-04-24T02:08:13.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.327+0000 7f07ae139640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07a809ce30 0x7f07a811ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:13.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.327+0000 7f07ae139640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07a809ce30 0x7f07a811ee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51708/0 (socket says 172.21.15.57:51708) 2024-04-24T02:08:13.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.327+0000 7f07ae139640 1 -- 172.21.15.57:0/496013200 learned_addr learned my addr 172.21.15.57:0/496013200 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:08:13.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.327+0000 7f07ae139640 1 -- 172.21.15.57:0/496013200 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07a8122f20 con 0x7f07a809ce30 2024-04-24T02:08:13.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.327+0000 7f07ae139640 1 --2- 172.21.15.57:0/496013200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07a809ce30 0x7f07a811ee90 crc :-1 s=READY pgs=12971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:13.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.327+0000 7f079effd640 1 -- 172.21.15.57:0/496013200 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f07a4013610 con 0x7f07a809ce30 2024-04-24T02:08:13.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.328+0000 7f079effd640 1 -- 172.21.15.57:0/496013200 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f07a4013770 con 0x7f07a809ce30 2024-04-24T02:08:13.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.328+0000 7f07b039d640 1 -- 172.21.15.57:0/496013200 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07a8121a50 con 0x7f07a809ce30 2024-04-24T02:08:13.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.328+0000 7f079effd640 1 -- 172.21.15.57:0/496013200 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f07a4013a10 con 0x7f07a809ce30 2024-04-24T02:08:13.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.328+0000 7f07b039d640 1 -- 172.21.15.57:0/496013200 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07a8122310 con 0x7f07a809ce30 2024-04-24T02:08:13.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.329+0000 7f07b039d640 1 -- 172.21.15.57:0/496013200 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07a8121c40 con 0x7f07a809ce30 2024-04-24T02:08:13.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.329+0000 7f079effd640 1 -- 172.21.15.57:0/496013200 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f07a4013bc0 con 0x7f07a809ce30 2024-04-24T02:08:13.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.329+0000 7f079effd640 1 --2- 172.21.15.57:0/496013200 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f078c038980 0x7f078c03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:13.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.329+0000 7f079effd640 1 -- 172.21.15.57:0/496013200 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(714..714 src has 395..714) ==== 3403+0+0 (crc 0 0 0) 0x7f07a4018040 con 0x7f07a809ce30 2024-04-24T02:08:13.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.329+0000 7f07ad938640 1 --2- 172.21.15.57:0/496013200 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f078c038980 0x7f078c03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:13.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.330+0000 7f07ad938640 1 --2- 172.21.15.57:0/496013200 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f078c038980 0x7f078c03ae90 crc :-1 s=READY pgs=3960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:13.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.334+0000 7f079effd640 1 -- 172.21.15.57:0/496013200 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f07a4018c30 con 0x7f07a809ce30 2024-04-24T02:08:13.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.521+0000 7f07b039d640 1 -- 172.21.15.57:0/496013200 --> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f07a809ba30 con 0x7f078c038980 2024-04-24T02:08:13.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.524+0000 7f079effd640 1 -- 172.21.15.57:0/496013200 <== mgr.4101 v2:172.21.15.84:6800/1747524692 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109148 (crc 0 0 0) 0x7f07a809ba30 con 0x7f078c038980 2024-04-24T02:08:13.526 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T02:08:13.527 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-24T02:08:13.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.527+0000 7f07b039d640 1 -- 172.21.15.57:0/496013200 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f078c038980 msgr2=0x7f078c03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:13.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.527+0000 7f07b039d640 1 --2- 172.21.15.57:0/496013200 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f078c038980 0x7f078c03ae90 crc :-1 s=READY pgs=3960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:13.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.527+0000 7f07b039d640 1 -- 172.21.15.57:0/496013200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07a809ce30 msgr2=0x7f07a811ee90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:13.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.527+0000 7f07b039d640 1 --2- 172.21.15.57:0/496013200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07a809ce30 0x7f07a811ee90 crc :-1 s=READY pgs=12971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:13.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.527+0000 7f07b039d640 1 -- 172.21.15.57:0/496013200 shutdown_connections 2024-04-24T02:08:13.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.527+0000 7f07b039d640 1 --2- 172.21.15.57:0/496013200 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f078c038980 0x7f078c03ae90 unknown :-1 s=CLOSED pgs=3960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:13.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.527+0000 7f07b039d640 1 --2- 172.21.15.57:0/496013200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07a809ce30 0x7f07a811ee90 unknown :-1 s=CLOSED pgs=12971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:13.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.527+0000 7f07b039d640 1 -- 172.21.15.57:0/496013200 >> 172.21.15.57:0/496013200 conn(0x7f07a809aa00 msgr2=0x7f07a80708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:13.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.527+0000 7f07b039d640 1 -- 172.21.15.57:0/496013200 shutdown_connections 2024-04-24T02:08:13.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.527+0000 7f07b039d640 1 -- 172.21.15.57:0/496013200 wait complete. 2024-04-24T02:08:13.540 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":1296,"stamp":"2024-04-24T02:08:13.196318+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590373,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":97,"num_write":144,"num_write_kb":1901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":296792,"kb_used_data":15480,"kb_used_omap":0,"kb_used_meta":281280,"kb_avail":419133608,"statfs":{"total":429496729600,"available":429192814592,"internally_reserved":0,"allocated":15851520,"data_stored":7088845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":288030720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-296900,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002114"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1269,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.324677+0000","last_change":"2024-04-24T01:54:29.908821+0000","last_active":"2024-04-24T02:07:40.324677+0000","last_peered":"2024-04-24T02:07:40.324677+0000","last_clean":"2024-04-24T02:07:40.324677+0000","last_became_active":"2024-04-24T01:54:29.899903+0000","last_became_peered":"2024-04-24T01:54:29.899903+0000","last_unstale":"2024-04-24T02:07:40.324677+0000","last_undegraded":"2024-04-24T02:07:40.324677+0000","last_fullsized":"2024-04-24T02:07:40.324677+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.857268+0000","last_change":"2024-04-24T01:54:29.967629+0000","last_active":"2024-04-24T02:07:39.857268+0000","last_peered":"2024-04-24T02:07:39.857268+0000","last_clean":"2024-04-24T02:07:39.857268+0000","last_became_active":"2024-04-24T01:54:29.955445+0000","last_became_peered":"2024-04-24T01:54:29.955445+0000","last_unstale":"2024-04-24T02:07:39.857268+0000","last_undegraded":"2024-04-24T02:07:39.857268+0000","last_fullsized":"2024-04-24T02:07:39.857268+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.144489+0000","last_change":"2024-04-24T01:54:29.885625+0000","last_active":"2024-04-24T02:07:40.144489+0000","last_peered":"2024-04-24T02:07:40.144489+0000","last_clean":"2024-04-24T02:07:40.144489+0000","last_became_active":"2024-04-24T01:54:29.877273+0000","last_became_peered":"2024-04-24T01:54:29.877273+0000","last_unstale":"2024-04-24T02:07:40.144489+0000","last_undegraded":"2024-04-24T02:07:40.144489+0000","last_fullsized":"2024-04-24T02:07:40.144489+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1237,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.160927+0000","last_change":"2024-04-24T01:54:29.885696+0000","last_active":"2024-04-24T02:07:40.160927+0000","last_peered":"2024-04-24T02:07:40.160927+0000","last_clean":"2024-04-24T02:07:40.160927+0000","last_became_active":"2024-04-24T01:54:29.878778+0000","last_became_peered":"2024-04-24T01:54:29.878778+0000","last_unstale":"2024-04-24T02:07:40.160927+0000","last_undegraded":"2024-04-24T02:07:40.160927+0000","last_fullsized":"2024-04-24T02:07:40.160927+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1269,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.339109+0000","last_change":"2024-04-24T01:54:29.953603+0000","last_active":"2024-04-24T02:07:40.339109+0000","last_peered":"2024-04-24T02:07:40.339109+0000","last_clean":"2024-04-24T02:07:40.339109+0000","last_became_active":"2024-04-24T01:54:29.938885+0000","last_became_peered":"2024-04-24T01:54:29.938885+0000","last_unstale":"2024-04-24T02:07:40.339109+0000","last_undegraded":"2024-04-24T02:07:40.339109+0000","last_fullsized":"2024-04-24T02:07:40.339109+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.812793+0000","last_change":"2024-04-24T01:54:29.937576+0000","last_active":"2024-04-24T02:07:39.812793+0000","last_peered":"2024-04-24T02:07:39.812793+0000","last_clean":"2024-04-24T02:07:39.812793+0000","last_became_active":"2024-04-24T01:54:29.925475+0000","last_became_peered":"2024-04-24T01:54:29.925475+0000","last_unstale":"2024-04-24T02:07:39.812793+0000","last_undegraded":"2024-04-24T02:07:39.812793+0000","last_fullsized":"2024-04-24T02:07:39.812793+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.866141+0000","last_change":"2024-04-24T01:54:30.009375+0000","last_active":"2024-04-24T02:07:39.866141+0000","last_peered":"2024-04-24T02:07:39.866141+0000","last_clean":"2024-04-24T02:07:39.866141+0000","last_became_active":"2024-04-24T01:54:30.002762+0000","last_became_peered":"2024-04-24T01:54:30.002762+0000","last_unstale":"2024-04-24T02:07:39.866141+0000","last_undegraded":"2024-04-24T02:07:39.866141+0000","last_fullsized":"2024-04-24T02:07:39.866141+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.886419+0000","last_change":"2024-04-24T01:54:29.958936+0000","last_active":"2024-04-24T02:07:39.886419+0000","last_peered":"2024-04-24T02:07:39.886419+0000","last_clean":"2024-04-24T02:07:39.886419+0000","last_became_active":"2024-04-24T01:54:29.940930+0000","last_became_peered":"2024-04-24T01:54:29.940930+0000","last_unstale":"2024-04-24T02:07:39.886419+0000","last_undegraded":"2024-04-24T02:07:39.886419+0000","last_fullsized":"2024-04-24T02:07:39.886419+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1237,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.169469+0000","last_change":"2024-04-24T01:54:29.927605+0000","last_active":"2024-04-24T02:07:40.169469+0000","last_peered":"2024-04-24T02:07:40.169469+0000","last_clean":"2024-04-24T02:07:40.169469+0000","last_became_active":"2024-04-24T01:54:29.915996+0000","last_became_peered":"2024-04-24T01:54:29.915996+0000","last_unstale":"2024-04-24T02:07:40.169469+0000","last_undegraded":"2024-04-24T02:07:40.169469+0000","last_fullsized":"2024-04-24T02:07:40.169469+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.158355+0000","last_change":"2024-04-24T01:54:29.937993+0000","last_active":"2024-04-24T02:07:40.158355+0000","last_peered":"2024-04-24T02:07:40.158355+0000","last_clean":"2024-04-24T02:07:40.158355+0000","last_became_active":"2024-04-24T01:54:29.932001+0000","last_became_peered":"2024-04-24T01:54:29.932001+0000","last_unstale":"2024-04-24T02:07:40.158355+0000","last_undegraded":"2024-04-24T02:07:40.158355+0000","last_fullsized":"2024-04-24T02:07:40.158355+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1237,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.114455+0000","last_change":"2024-04-24T01:54:29.983449+0000","last_active":"2024-04-24T02:07:40.114455+0000","last_peered":"2024-04-24T02:07:40.114455+0000","last_clean":"2024-04-24T02:07:40.114455+0000","last_became_active":"2024-04-24T01:54:29.977785+0000","last_became_peered":"2024-04-24T01:54:29.977785+0000","last_unstale":"2024-04-24T02:07:40.114455+0000","last_undegraded":"2024-04-24T02:07:40.114455+0000","last_fullsized":"2024-04-24T02:07:40.114455+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.892640+0000","last_change":"2024-04-24T01:54:29.984917+0000","last_active":"2024-04-24T02:07:39.892640+0000","last_peered":"2024-04-24T02:07:39.892640+0000","last_clean":"2024-04-24T02:07:39.892640+0000","last_became_active":"2024-04-24T01:54:29.974222+0000","last_became_peered":"2024-04-24T01:54:29.974222+0000","last_unstale":"2024-04-24T02:07:39.892640+0000","last_undegraded":"2024-04-24T02:07:39.892640+0000","last_fullsized":"2024-04-24T02:07:39.892640+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1237,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.102021+0000","last_change":"2024-04-24T01:54:30.012455+0000","last_active":"2024-04-24T02:07:40.102021+0000","last_peered":"2024-04-24T02:07:40.102021+0000","last_clean":"2024-04-24T02:07:40.102021+0000","last_became_active":"2024-04-24T01:54:30.006792+0000","last_became_peered":"2024-04-24T01:54:30.006792+0000","last_unstale":"2024-04-24T02:07:40.102021+0000","last_undegraded":"2024-04-24T02:07:40.102021+0000","last_fullsized":"2024-04-24T02:07:40.102021+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1237,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.134415+0000","last_change":"2024-04-24T01:54:29.931288+0000","last_active":"2024-04-24T02:07:40.134415+0000","last_peered":"2024-04-24T02:07:40.134415+0000","last_clean":"2024-04-24T02:07:40.134415+0000","last_became_active":"2024-04-24T01:54:29.921241+0000","last_became_peered":"2024-04-24T01:54:29.921241+0000","last_unstale":"2024-04-24T02:07:40.134415+0000","last_undegraded":"2024-04-24T02:07:40.134415+0000","last_fullsized":"2024-04-24T02:07:40.134415+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.869045+0000","last_change":"2024-04-24T01:54:29.944487+0000","last_active":"2024-04-24T02:07:39.869045+0000","last_peered":"2024-04-24T02:07:39.869045+0000","last_clean":"2024-04-24T02:07:39.869045+0000","last_became_active":"2024-04-24T01:54:29.929555+0000","last_became_peered":"2024-04-24T01:54:29.929555+0000","last_unstale":"2024-04-24T02:07:39.869045+0000","last_undegraded":"2024-04-24T02:07:39.869045+0000","last_fullsized":"2024-04-24T02:07:39.869045+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.858896+0000","last_change":"2024-04-24T01:54:29.970476+0000","last_active":"2024-04-24T02:07:39.858896+0000","last_peered":"2024-04-24T02:07:39.858896+0000","last_clean":"2024-04-24T02:07:39.858896+0000","last_became_active":"2024-04-24T01:54:29.949994+0000","last_became_peered":"2024-04-24T01:54:29.949994+0000","last_unstale":"2024-04-24T02:07:39.858896+0000","last_undegraded":"2024-04-24T02:07:39.858896+0000","last_fullsized":"2024-04-24T02:07:39.858896+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.898282+0000","last_change":"2024-04-24T01:54:29.978873+0000","last_active":"2024-04-24T02:07:39.898282+0000","last_peered":"2024-04-24T02:07:39.898282+0000","last_clean":"2024-04-24T02:07:39.898282+0000","last_became_active":"2024-04-24T01:54:29.962939+0000","last_became_peered":"2024-04-24T01:54:29.962939+0000","last_unstale":"2024-04-24T02:07:39.898282+0000","last_undegraded":"2024-04-24T02:07:39.898282+0000","last_fullsized":"2024-04-24T02:07:39.898282+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1237,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.121817+0000","last_change":"2024-04-24T01:54:29.967298+0000","last_active":"2024-04-24T02:07:40.121817+0000","last_peered":"2024-04-24T02:07:40.121817+0000","last_clean":"2024-04-24T02:07:40.121817+0000","last_became_active":"2024-04-24T01:54:29.960381+0000","last_became_peered":"2024-04-24T01:54:29.960381+0000","last_unstale":"2024-04-24T02:07:40.121817+0000","last_undegraded":"2024-04-24T02:07:40.121817+0000","last_fullsized":"2024-04-24T02:07:40.121817+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.132185+0000","last_change":"2024-04-24T01:54:29.883604+0000","last_active":"2024-04-24T02:07:40.132185+0000","last_peered":"2024-04-24T02:07:40.132185+0000","last_clean":"2024-04-24T02:07:40.132185+0000","last_became_active":"2024-04-24T01:54:29.874172+0000","last_became_peered":"2024-04-24T01:54:29.874172+0000","last_unstale":"2024-04-24T02:07:40.132185+0000","last_undegraded":"2024-04-24T02:07:40.132185+0000","last_fullsized":"2024-04-24T02:07:40.132185+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1269,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.314904+0000","last_change":"2024-04-24T01:54:29.959775+0000","last_active":"2024-04-24T02:07:40.314904+0000","last_peered":"2024-04-24T02:07:40.314904+0000","last_clean":"2024-04-24T02:07:40.314904+0000","last_became_active":"2024-04-24T01:54:29.950635+0000","last_became_peered":"2024-04-24T01:54:29.950635+0000","last_unstale":"2024-04-24T02:07:40.314904+0000","last_undegraded":"2024-04-24T02:07:40.314904+0000","last_fullsized":"2024-04-24T02:07:40.314904+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1269,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.334948+0000","last_change":"2024-04-24T01:54:29.988510+0000","last_active":"2024-04-24T02:07:40.334948+0000","last_peered":"2024-04-24T02:07:40.334948+0000","last_clean":"2024-04-24T02:07:40.334948+0000","last_became_active":"2024-04-24T01:54:29.981633+0000","last_became_peered":"2024-04-24T01:54:29.981633+0000","last_unstale":"2024-04-24T02:07:40.334948+0000","last_undegraded":"2024-04-24T02:07:40.334948+0000","last_fullsized":"2024-04-24T02:07:40.334948+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1269,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.318876+0000","last_change":"2024-04-24T01:54:29.973040+0000","last_active":"2024-04-24T02:07:40.318876+0000","last_peered":"2024-04-24T02:07:40.318876+0000","last_clean":"2024-04-24T02:07:40.318876+0000","last_became_active":"2024-04-24T01:54:29.963206+0000","last_became_peered":"2024-04-24T01:54:29.963206+0000","last_unstale":"2024-04-24T02:07:40.318876+0000","last_undegraded":"2024-04-24T02:07:40.318876+0000","last_fullsized":"2024-04-24T02:07:40.318876+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.127302+0000","last_change":"2024-04-24T01:54:29.916876+0000","last_active":"2024-04-24T02:07:40.127302+0000","last_peered":"2024-04-24T02:07:40.127302+0000","last_clean":"2024-04-24T02:07:40.127302+0000","last_became_active":"2024-04-24T01:54:29.899615+0000","last_became_peered":"2024-04-24T01:54:29.899615+0000","last_unstale":"2024-04-24T02:07:40.127302+0000","last_undegraded":"2024-04-24T02:07:40.127302+0000","last_fullsized":"2024-04-24T02:07:40.127302+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1237,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.142993+0000","last_change":"2024-04-24T01:54:29.942521+0000","last_active":"2024-04-24T02:07:40.142993+0000","last_peered":"2024-04-24T02:07:40.142993+0000","last_clean":"2024-04-24T02:07:40.142993+0000","last_became_active":"2024-04-24T01:54:29.933820+0000","last_became_peered":"2024-04-24T01:54:29.933820+0000","last_unstale":"2024-04-24T02:07:40.142993+0000","last_undegraded":"2024-04-24T02:07:40.142993+0000","last_fullsized":"2024-04-24T02:07:40.142993+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1237,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.118742+0000","last_change":"2024-04-24T01:54:29.903130+0000","last_active":"2024-04-24T02:07:40.118742+0000","last_peered":"2024-04-24T02:07:40.118742+0000","last_clean":"2024-04-24T02:07:40.118742+0000","last_became_active":"2024-04-24T01:54:29.897105+0000","last_became_peered":"2024-04-24T01:54:29.897105+0000","last_unstale":"2024-04-24T02:07:40.118742+0000","last_undegraded":"2024-04-24T02:07:40.118742+0000","last_fullsized":"2024-04-24T02:07:40.118742+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.883017+0000","last_change":"2024-04-24T01:54:29.935141+0000","last_active":"2024-04-24T02:07:39.883017+0000","last_peered":"2024-04-24T02:07:39.883017+0000","last_clean":"2024-04-24T02:07:39.883017+0000","last_became_active":"2024-04-24T01:54:29.920622+0000","last_became_peered":"2024-04-24T01:54:29.920622+0000","last_unstale":"2024-04-24T02:07:39.883017+0000","last_undegraded":"2024-04-24T02:07:39.883017+0000","last_fullsized":"2024-04-24T02:07:39.883017+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1237,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.131673+0000","last_change":"2024-04-24T01:54:29.954567+0000","last_active":"2024-04-24T02:07:40.131673+0000","last_peered":"2024-04-24T02:07:40.131673+0000","last_clean":"2024-04-24T02:07:40.131673+0000","last_became_active":"2024-04-24T01:54:29.946732+0000","last_became_peered":"2024-04-24T01:54:29.946732+0000","last_unstale":"2024-04-24T02:07:40.131673+0000","last_undegraded":"2024-04-24T02:07:40.131673+0000","last_fullsized":"2024-04-24T02:07:40.131673+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.871567+0000","last_change":"2024-04-24T01:54:30.051664+0000","last_active":"2024-04-24T02:07:39.871567+0000","last_peered":"2024-04-24T02:07:39.871567+0000","last_clean":"2024-04-24T02:07:39.871567+0000","last_became_active":"2024-04-24T01:54:30.037754+0000","last_became_peered":"2024-04-24T01:54:30.037754+0000","last_unstale":"2024-04-24T02:07:39.871567+0000","last_undegraded":"2024-04-24T02:07:39.871567+0000","last_fullsized":"2024-04-24T02:07:39.871567+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.867185+0000","last_change":"2024-04-24T01:54:29.911375+0000","last_active":"2024-04-24T02:07:39.867185+0000","last_peered":"2024-04-24T02:07:39.867185+0000","last_clean":"2024-04-24T02:07:39.867185+0000","last_became_active":"2024-04-24T01:54:29.904467+0000","last_became_peered":"2024-04-24T01:54:29.904467+0000","last_unstale":"2024-04-24T02:07:39.867185+0000","last_undegraded":"2024-04-24T02:07:39.867185+0000","last_fullsized":"2024-04-24T02:07:39.867185+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:39.904719+0000","last_change":"2024-04-24T01:54:30.026621+0000","last_active":"2024-04-24T02:07:39.904719+0000","last_peered":"2024-04-24T02:07:39.904719+0000","last_clean":"2024-04-24T02:07:39.904719+0000","last_became_active":"2024-04-24T01:54:30.019236+0000","last_became_peered":"2024-04-24T01:54:30.019236+0000","last_unstale":"2024-04-24T02:07:39.904719+0000","last_undegraded":"2024-04-24T02:07:39.904719+0000","last_fullsized":"2024-04-24T02:07:39.904719+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1282,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.328656+0000","last_change":"2024-04-24T01:54:29.879709+0000","last_active":"2024-04-24T02:07:40.328656+0000","last_peered":"2024-04-24T02:07:40.328656+0000","last_clean":"2024-04-24T02:07:40.328656+0000","last_became_active":"2024-04-24T01:54:29.873358+0000","last_became_peered":"2024-04-24T01:54:29.873358+0000","last_unstale":"2024-04-24T02:07:40.328656+0000","last_undegraded":"2024-04-24T02:07:40.328656+0000","last_fullsized":"2024-04-24T02:07:40.328656+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1271,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.187754+0000","last_change":"2024-04-24T01:54:29.921138+0000","last_active":"2024-04-24T02:07:40.187754+0000","last_peered":"2024-04-24T02:07:40.187754+0000","last_clean":"2024-04-24T02:07:40.187754+0000","last_became_active":"2024-04-24T01:54:29.909001+0000","last_became_peered":"2024-04-24T01:54:29.909001+0000","last_unstale":"2024-04-24T02:07:40.187754+0000","last_undegraded":"2024-04-24T02:07:40.187754+0000","last_fullsized":"2024-04-24T02:07:40.187754+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1859,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.459062+0000","last_change":"2024-04-24T01:48:40.062414+0000","last_active":"2024-04-24T02:07:40.459062+0000","last_peered":"2024-04-24T02:07:40.459062+0000","last_clean":"2024-04-24T02:07:40.459062+0000","last_became_active":"2024-04-24T01:48:40.055629+0000","last_became_peered":"2024-04-24T01:48:40.055629+0000","last_unstale":"2024-04-24T02:07:40.459062+0000","last_undegraded":"2024-04-24T02:07:40.459062+0000","last_fullsized":"2024-04-24T02:07:40.459062+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1861,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.291589+0000","last_change":"2024-04-24T01:48:40.045311+0000","last_active":"2024-04-24T02:07:40.291589+0000","last_peered":"2024-04-24T02:07:40.291589+0000","last_clean":"2024-04-24T02:07:40.291589+0000","last_became_active":"2024-04-24T01:48:40.041551+0000","last_became_peered":"2024-04-24T01:48:40.041551+0000","last_unstale":"2024-04-24T02:07:40.291589+0000","last_undegraded":"2024-04-24T02:07:40.291589+0000","last_fullsized":"2024-04-24T02:07:40.291589+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1843,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.285912+0000","last_change":"2024-04-24T01:48:40.045108+0000","last_active":"2024-04-24T02:07:40.285912+0000","last_peered":"2024-04-24T02:07:40.285912+0000","last_clean":"2024-04-24T02:07:40.285912+0000","last_became_active":"2024-04-24T01:48:40.038574+0000","last_became_peered":"2024-04-24T01:48:40.038574+0000","last_unstale":"2024-04-24T02:07:40.285912+0000","last_undegraded":"2024-04-24T02:07:40.285912+0000","last_fullsized":"2024-04-24T02:07:40.285912+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1861,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.155215+0000","last_change":"2024-04-24T01:48:40.035237+0000","last_active":"2024-04-24T02:07:40.155215+0000","last_peered":"2024-04-24T02:07:40.155215+0000","last_clean":"2024-04-24T02:07:40.155215+0000","last_became_active":"2024-04-24T01:48:40.030062+0000","last_became_peered":"2024-04-24T01:48:40.030062+0000","last_unstale":"2024-04-24T02:07:40.155215+0000","last_undegraded":"2024-04-24T02:07:40.155215+0000","last_fullsized":"2024-04-24T02:07:40.155215+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1869,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.010295+0000","last_change":"2024-04-24T01:48:40.046631+0000","last_active":"2024-04-24T02:07:40.010295+0000","last_peered":"2024-04-24T02:07:40.010295+0000","last_clean":"2024-04-24T02:07:40.010295+0000","last_became_active":"2024-04-24T01:48:40.040843+0000","last_became_peered":"2024-04-24T01:48:40.040843+0000","last_unstale":"2024-04-24T02:07:40.010295+0000","last_undegraded":"2024-04-24T02:07:40.010295+0000","last_fullsized":"2024-04-24T02:07:40.010295+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1859,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.353868+0000","last_change":"2024-04-24T01:48:40.043159+0000","last_active":"2024-04-24T02:07:40.353868+0000","last_peered":"2024-04-24T02:07:40.353868+0000","last_clean":"2024-04-24T02:07:40.353868+0000","last_became_active":"2024-04-24T01:48:40.033297+0000","last_became_peered":"2024-04-24T01:48:40.033297+0000","last_unstale":"2024-04-24T02:07:40.353868+0000","last_undegraded":"2024-04-24T02:07:40.353868+0000","last_fullsized":"2024-04-24T02:07:40.353868+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1869,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.008819+0000","last_change":"2024-04-24T01:48:40.063620+0000","last_active":"2024-04-24T02:07:40.008819+0000","last_peered":"2024-04-24T02:07:40.008819+0000","last_clean":"2024-04-24T02:07:40.008819+0000","last_became_active":"2024-04-24T01:48:40.054792+0000","last_became_peered":"2024-04-24T01:48:40.054792+0000","last_unstale":"2024-04-24T02:07:40.008819+0000","last_undegraded":"2024-04-24T02:07:40.008819+0000","last_fullsized":"2024-04-24T02:07:40.008819+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1859,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.435500+0000","last_change":"2024-04-24T01:48:40.057853+0000","last_active":"2024-04-24T02:07:40.435500+0000","last_peered":"2024-04-24T02:07:40.435500+0000","last_clean":"2024-04-24T02:07:40.435500+0000","last_became_active":"2024-04-24T01:48:40.052084+0000","last_became_peered":"2024-04-24T01:48:40.052084+0000","last_unstale":"2024-04-24T02:07:40.435500+0000","last_undegraded":"2024-04-24T02:07:40.435500+0000","last_fullsized":"2024-04-24T02:07:40.435500+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":1976,"reported_epoch":712,"state":"active+clean","last_fresh":"2024-04-24T02:07:40.159792+0000","last_change":"2024-04-24T01:48:38.013745+0000","last_active":"2024-04-24T02:07:40.159792+0000","last_peered":"2024-04-24T02:07:40.159792+0000","last_clean":"2024-04-24T02:07:40.159792+0000","last_became_active":"2024-04-24T01:48:38.008438+0000","last_became_peered":"2024-04-24T01:48:38.008438+0000","last_unstale":"2024-04-24T02:07:40.159792+0000","last_undegraded":"2024-04-24T02:07:40.159792+0000","last_fullsized":"2024-04-24T02:07:40.159792+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:36.956380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:36.956380+0000","last_clean_scrub_stamp":"2024-04-24T01:48:36.956380+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706837,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":67152,"kb_used_data":4104,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":104790448,"statfs":{"total":107374182400,"available":107305418752,"internally_reserved":0,"allocated":4202496,"data_stored":2051882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706837,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":79144,"kb_used_data":3616,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104778456,"statfs":{"total":107374182400,"available":107293138944,"internally_reserved":0,"allocated":3702784,"data_stored":1478912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706837,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":79080,"kb_used_data":3552,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104778520,"statfs":{"total":107374182400,"available":107293204480,"internally_reserved":0,"allocated":3637248,"data_stored":1476802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706837,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":71416,"kb_used_data":4208,"kb_used_omap":0,"kb_used_meta":67200,"kb_avail":104786184,"statfs":{"total":107374182400,"available":107301052416,"internally_reserved":0,"allocated":4308992,"data_stored":2081249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68812800},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T02:08:13.542 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T02:08:13.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.648+0000 7f723fd9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:13.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.653+0000 7f723fd9d640 1 Processor -- start 2024-04-24T02:08:13.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.653+0000 7f723fd9d640 1 -- start start 2024-04-24T02:08:13.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.655+0000 7f723fd9d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f723806bca0 0x7f723806c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:13.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.655+0000 7f723fd9d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7238073b80 con 0x7f723806c5f0 2024-04-24T02:08:13.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.655+0000 7f723fd9d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f723809dec0 con 0x7f723806bca0 2024-04-24T02:08:13.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.655+0000 7f723db39640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f723806bca0 0x7f723806c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:13.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.655+0000 7f723d338640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f723806c5f0 0x7f723812f320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39812/0 (socket says 172.21.15.57:39812) 2024-04-24T02:08:13.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.655+0000 7f723d338640 1 -- 172.21.15.57:0/2832581879 learned_addr learned my addr 172.21.15.57:0/2832581879 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T02:08:13.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.656+0000 7f723db39640 1 -- 172.21.15.57:0/2832581879 >> v1:172.21.15.57:6789/0 conn(0x7f723806c5f0 legacy=0x7f723812f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:13.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.656+0000 7f723db39640 1 -- 172.21.15.57:0/2832581879 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f723809dbf0 con 0x7f723806bca0 2024-04-24T02:08:13.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.656+0000 7f723db39640 1 --2- 172.21.15.57:0/2832581879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f723806bca0 0x7f723806c0b0 crc :-1 s=READY pgs=12973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daba2d617f0d7388 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:13.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.656+0000 7f723cb37640 1 -- 172.21.15.57:0/2832581879 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7230009d90 con 0x7f723806bca0 2024-04-24T02:08:13.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.656+0000 7f723cb37640 1 -- 172.21.15.57:0/2832581879 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f723000e230 con 0x7f723806bca0 2024-04-24T02:08:13.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.656+0000 7f723cb37640 1 -- 172.21.15.57:0/2832581879 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f723000e4d0 con 0x7f723806bca0 2024-04-24T02:08:13.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.656+0000 7f723fd9d640 1 -- 172.21.15.57:0/2832581879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f723806bca0 msgr2=0x7f723806c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:13.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.657+0000 7f723fd9d640 1 --2- 172.21.15.57:0/2832581879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f723806bca0 0x7f723806c0b0 crc :-1 s=READY pgs=12973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:13.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.657+0000 7f723fd9d640 1 -- 172.21.15.57:0/2832581879 shutdown_connections 2024-04-24T02:08:13.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.657+0000 7f723fd9d640 1 --2- 172.21.15.57:0/2832581879 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f723806bca0 0x7f723806c0b0 unknown :-1 s=CLOSED pgs=12973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:13.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.657+0000 7f723fd9d640 1 -- 172.21.15.57:0/2832581879 >> 172.21.15.57:0/2832581879 conn(0x7f72380a1a80 msgr2=0x7f72380a1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:13.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.657+0000 7f723fd9d640 1 -- 172.21.15.57:0/2832581879 shutdown_connections 2024-04-24T02:08:13.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.657+0000 7f723fd9d640 1 -- 172.21.15.57:0/2832581879 wait complete. 2024-04-24T02:08:13.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.657+0000 7f723fd9d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:13.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.659+0000 7f723fd9d640 1 Processor -- start 2024-04-24T02:08:13.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.659+0000 7f723fd9d640 1 -- start start 2024-04-24T02:08:13.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.660+0000 7f723fd9d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f723806bca0 0x7f723811b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:13.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.660+0000 7f723fd9d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f723811ccf0 con 0x7f723806bca0 2024-04-24T02:08:13.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.660+0000 7f723db39640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f723806bca0 0x7f723811b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:13.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.660+0000 7f723db39640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f723806bca0 0x7f723811b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51720/0 (socket says 172.21.15.57:51720) 2024-04-24T02:08:13.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.660+0000 7f723db39640 1 -- 172.21.15.57:0/1198643295 learned_addr learned my addr 172.21.15.57:0/1198643295 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:08:13.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.660+0000 7f723db39640 1 -- 172.21.15.57:0/1198643295 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f723806b480 con 0x7f723806bca0 2024-04-24T02:08:13.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.661+0000 7f723db39640 1 --2- 172.21.15.57:0/1198643295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f723806bca0 0x7f723811b1c0 crc :-1 s=READY pgs=12974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:13.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.661+0000 7f72367fc640 1 -- 172.21.15.57:0/1198643295 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7230014620 con 0x7f723806bca0 2024-04-24T02:08:13.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.661+0000 7f72367fc640 1 -- 172.21.15.57:0/1198643295 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7230014780 con 0x7f723806bca0 2024-04-24T02:08:13.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.661+0000 7f723fd9d640 1 -- 172.21.15.57:0/1198643295 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f723811e270 con 0x7f723806bca0 2024-04-24T02:08:13.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.661+0000 7f72367fc640 1 -- 172.21.15.57:0/1198643295 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7230014a20 con 0x7f723806bca0 2024-04-24T02:08:13.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.661+0000 7f723fd9d640 1 -- 172.21.15.57:0/1198643295 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f723811e4d0 con 0x7f723806bca0 2024-04-24T02:08:13.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.662+0000 7f723fd9d640 1 -- 172.21.15.57:0/1198643295 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7238063900 con 0x7f723806bca0 2024-04-24T02:08:13.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.662+0000 7f72367fc640 1 -- 172.21.15.57:0/1198643295 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f7230014bd0 con 0x7f723806bca0 2024-04-24T02:08:13.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.662+0000 7f72367fc640 1 --2- 172.21.15.57:0/1198643295 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f7224038980 0x7f722403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:13.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.662+0000 7f72367fc640 1 -- 172.21.15.57:0/1198643295 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(714..714 src has 395..714) ==== 3403+0+0 (crc 0 0 0) 0x7f7230019040 con 0x7f723806bca0 2024-04-24T02:08:13.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.663+0000 7f723d338640 1 --2- 172.21.15.57:0/1198643295 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f7224038980 0x7f722403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:13.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.663+0000 7f723d338640 1 --2- 172.21.15.57:0/1198643295 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f7224038980 0x7f722403ae90 crc :-1 s=READY pgs=3961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:13.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.667+0000 7f72367fc640 1 -- 172.21.15.57:0/1198643295 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f7230018190 con 0x7f723806bca0 2024-04-24T02:08:13.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.860+0000 7f723fd9d640 1 -- 172.21.15.57:0/1198643295 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f723806b480 con 0x7f723806bca0 2024-04-24T02:08:13.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.861+0000 7f72367fc640 1 -- 172.21.15.57:0/1198643295 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v714) ==== 74+0+11111 (crc 0 0 0) 0x7f723806b480 con 0x7f723806bca0 2024-04-24T02:08:13.862 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T02:08:13.863 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":714,"fsid":"2097e8c9-9d10-45f4-a30f-1b3cf153e5e6","created":"2024-04-24T01:48:28.514903+0000","modified":"2024-04-24T02:08:11.858057+0000","last_up_change":"2024-04-24T01:48:34.951142+0000","last_in_change":"2024-04-24T01:48:30.670792+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":201,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":true,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T01:48:36.926526+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-24T01:48:38.847556+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":75,"pool_name":"ceph_test_rados_api_asio","create_time":"2024-04-24T01:54:27.755370+0000","flags":262177,"flags_names":"hashpspool,nopgchange,crimson","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"238","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"fa3dfb45-b86e-45f6-8763-4e2da341521a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":701,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6801","nonce":2208289758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2208289758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6807","nonce":2208289758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":2208289758}]},"public_addr":"172.21.15.57:6801/2208289758","cluster_addr":"172.21.15.57:6802/2208289758","heartbeat_back_addr":"172.21.15.57:6807/2208289758","heartbeat_front_addr":"172.21.15.57:6808/2208289758","state":["exists","up"]},{"osd":1,"uuid":"983d404f-e45f-476b-aba9-7295e360b0c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":701,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6805","nonce":2600611357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2600611357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2600611357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6803","nonce":2600611357}]},"public_addr":"172.21.15.57:6805/2600611357","cluster_addr":"172.21.15.57:6804/2600611357","heartbeat_back_addr":"172.21.15.57:6806/2600611357","heartbeat_front_addr":"172.21.15.57:6803/2600611357","state":["exists","up"]},{"osd":2,"uuid":"7c919704-afb7-4a77-afb5-0480a2a172dd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":701,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6805","nonce":1003835807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6804","nonce":1003835807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6807","nonce":1003835807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6806","nonce":1003835807}]},"public_addr":"172.21.15.84:6805/1003835807","cluster_addr":"172.21.15.84:6804/1003835807","heartbeat_back_addr":"172.21.15.84:6807/1003835807","heartbeat_front_addr":"172.21.15.84:6806/1003835807","state":["exists","up"]},{"osd":3,"uuid":"8f156a3e-e3eb-4b10-85b5-0b3c99a5057e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":701,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6808","nonce":91137974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6809","nonce":91137974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6802","nonce":91137974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.84:6803","nonce":91137974}]},"public_addr":"172.21.15.84:6808/91137974","cluster_addr":"172.21.15.84:6809/91137974","heartbeat_back_addr":"172.21.15.84:6802/91137974","heartbeat_front_addr":"172.21.15.84:6803/91137974","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":100,"snaps":[{"begin":1,"length":4}]},{"pool":101,"snaps":[{"begin":2,"length":4},{"begin":7,"length":2}]},{"pool":102,"snaps":[{"begin":1,"length":6}]},{"pool":103,"snaps":[{"begin":2,"length":4},{"begin":9,"length":1}]},{"pool":104,"snaps":[{"begin":2,"length":1}]},{"pool":180,"snaps":[{"begin":1,"length":1}]},{"pool":181,"snaps":[{"begin":1,"length":1}]},{"pool":183,"snaps":[{"begin":1,"length":1}]},{"pool":184,"snaps":[{"begin":1,"length":2}]},{"pool":185,"snaps":[{"begin":3,"length":1}]},{"pool":188,"snaps":[{"begin":2,"length":2}]},{"pool":190,"snaps":[{"begin":3,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T02:08:13.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.863+0000 7f723fd9d640 1 -- 172.21.15.57:0/1198643295 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f7224038980 msgr2=0x7f722403ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:13.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.863+0000 7f723fd9d640 1 --2- 172.21.15.57:0/1198643295 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f7224038980 0x7f722403ae90 crc :-1 s=READY pgs=3961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:13.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.863+0000 7f723fd9d640 1 -- 172.21.15.57:0/1198643295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f723806bca0 msgr2=0x7f723811b1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:13.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.863+0000 7f723fd9d640 1 --2- 172.21.15.57:0/1198643295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f723806bca0 0x7f723811b1c0 crc :-1 s=READY pgs=12974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:13.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.863+0000 7f723fd9d640 1 -- 172.21.15.57:0/1198643295 shutdown_connections 2024-04-24T02:08:13.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.863+0000 7f723fd9d640 1 --2- 172.21.15.57:0/1198643295 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f7224038980 0x7f722403ae90 unknown :-1 s=CLOSED pgs=3961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:13.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.863+0000 7f723fd9d640 1 --2- 172.21.15.57:0/1198643295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f723806bca0 0x7f723811b1c0 unknown :-1 s=CLOSED pgs=12974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:13.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.863+0000 7f723fd9d640 1 -- 172.21.15.57:0/1198643295 >> 172.21.15.57:0/1198643295 conn(0x7f72380a1a80 msgr2=0x7f723812f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:13.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.863+0000 7f723fd9d640 1 -- 172.21.15.57:0/1198643295 shutdown_connections 2024-04-24T02:08:13.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:13.863+0000 7f723fd9d640 1 -- 172.21.15.57:0/1198643295 wait complete. 2024-04-24T02:08:14.877 INFO:tasks.ceph:Scrubbing osd.0 2024-04-24T02:08:14.877 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-24T02:08:14.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:14.985+0000 7f0b2b19d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:14.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:14.995+0000 7f0b2b19d640 1 Processor -- start 2024-04-24T02:08:14.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:14.995+0000 7f0b2b19d640 1 -- start start 2024-04-24T02:08:14.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:14.996+0000 7f0b2b19d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0b2409e750 0x7f0b240a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:14.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:14.996+0000 7f0b2b19d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b2409de70 con 0x7f0b240a1020 2024-04-24T02:08:14.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:14.996+0000 7f0b2b19d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f0b240a1430 con 0x7f0b2409e750 2024-04-24T02:08:14.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:14.997+0000 7f0b28f39640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0b2409e750 0x7f0b240a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:14.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:14.997+0000 7f0b23fff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0b240a1020 0x7f0b24134970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39818/0 (socket says 172.21.15.57:39818) 2024-04-24T02:08:14.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:14.997+0000 7f0b23fff640 1 -- 172.21.15.57:0/1123451889 learned_addr learned my addr 172.21.15.57:0/1123451889 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T02:08:14.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:14.997+0000 7f0b28f39640 1 -- 172.21.15.57:0/1123451889 >> v1:172.21.15.57:6789/0 conn(0x7f0b240a1020 legacy=0x7f0b24134970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:14.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:14.997+0000 7f0b28f39640 1 -- 172.21.15.57:0/1123451889 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b240a0690 con 0x7f0b2409e750 2024-04-24T02:08:14.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:14.997+0000 7f0b28f39640 1 --2- 172.21.15.57:0/1123451889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b2409e750 0x7f0b240a0ae0 crc :-1 s=READY pgs=12976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a035a1abc13e2f99 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:14.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:14.997+0000 7f0b237fe640 1 -- 172.21.15.57:0/1123451889 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0b18009d90 con 0x7f0b2409e750 2024-04-24T02:08:14.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:14.997+0000 7f0b237fe640 1 -- 172.21.15.57:0/1123451889 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0b1800e230 con 0x7f0b2409e750 2024-04-24T02:08:14.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:14.997+0000 7f0b237fe640 1 -- 172.21.15.57:0/1123451889 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0b1800e4d0 con 0x7f0b2409e750 2024-04-24T02:08:15.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:14.998+0000 7f0b2b19d640 1 -- 172.21.15.57:0/1123451889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b2409e750 msgr2=0x7f0b240a0ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:15.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:14.998+0000 7f0b2b19d640 1 --2- 172.21.15.57:0/1123451889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b2409e750 0x7f0b240a0ae0 crc :-1 s=READY pgs=12976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:15.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:14.998+0000 7f0b2b19d640 1 -- 172.21.15.57:0/1123451889 shutdown_connections 2024-04-24T02:08:15.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:14.998+0000 7f0b2b19d640 1 --2- 172.21.15.57:0/1123451889 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b2409e750 0x7f0b240a0ae0 unknown :-1 s=CLOSED pgs=12976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:15.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:14.998+0000 7f0b2b19d640 1 -- 172.21.15.57:0/1123451889 >> 172.21.15.57:0/1123451889 conn(0x7f0b240a3d60 msgr2=0x7f0b240a4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:15.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:14.998+0000 7f0b2b19d640 1 -- 172.21.15.57:0/1123451889 shutdown_connections 2024-04-24T02:08:15.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:14.998+0000 7f0b2b19d640 1 -- 172.21.15.57:0/1123451889 wait complete. 2024-04-24T02:08:15.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:14.998+0000 7f0b2b19d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:15.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.000+0000 7f0b2b19d640 1 Processor -- start 2024-04-24T02:08:15.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.000+0000 7f0b2b19d640 1 -- start start 2024-04-24T02:08:15.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.002+0000 7f0b2b19d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b2409e750 0x7f0b2411e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:15.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.002+0000 7f0b2b19d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0b241221e0 con 0x7f0b2409e750 2024-04-24T02:08:15.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.002+0000 7f0b28f39640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b2409e750 0x7f0b2411e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:15.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.002+0000 7f0b28f39640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b2409e750 0x7f0b2411e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51744/0 (socket says 172.21.15.57:51744) 2024-04-24T02:08:15.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.002+0000 7f0b28f39640 1 -- 172.21.15.57:0/1015991363 learned_addr learned my addr 172.21.15.57:0/1015991363 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:08:15.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.002+0000 7f0b28f39640 1 -- 172.21.15.57:0/1015991363 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b24132250 con 0x7f0b2409e750 2024-04-24T02:08:15.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.002+0000 7f0b28f39640 1 --2- 172.21.15.57:0/1015991363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b2409e750 0x7f0b2411e050 crc :-1 s=READY pgs=12977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:15.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.002+0000 7f0b217fa640 1 -- 172.21.15.57:0/1015991363 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0b18014620 con 0x7f0b2409e750 2024-04-24T02:08:15.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.002+0000 7f0b217fa640 1 -- 172.21.15.57:0/1015991363 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f0b18014780 con 0x7f0b2409e750 2024-04-24T02:08:15.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.002+0000 7f0b2b19d640 1 -- 172.21.15.57:0/1015991363 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b24120590 con 0x7f0b2409e750 2024-04-24T02:08:15.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.002+0000 7f0b217fa640 1 -- 172.21.15.57:0/1015991363 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f0b18014a20 con 0x7f0b2409e750 2024-04-24T02:08:15.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.003+0000 7f0b2b19d640 1 -- 172.21.15.57:0/1015991363 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b24120d90 con 0x7f0b2409e750 2024-04-24T02:08:15.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.003+0000 7f0b217fa640 1 -- 172.21.15.57:0/1015991363 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f0b18014bd0 con 0x7f0b2409e750 2024-04-24T02:08:15.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.003+0000 7f0b2b19d640 1 -- 172.21.15.57:0/1015991363 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0b2409e430 con 0x7f0b2409e750 2024-04-24T02:08:15.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.004+0000 7f0b217fa640 1 --2- 172.21.15.57:0/1015991363 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f0b08038980 0x7f0b0803ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:15.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.004+0000 7f0b217fa640 1 -- 172.21.15.57:0/1015991363 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(714..714 src has 395..714) ==== 3403+0+0 (crc 0 0 0) 0x7f0b18019040 con 0x7f0b2409e750 2024-04-24T02:08:15.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.004+0000 7f0b217fa640 1 --2- 172.21.15.57:0/1015991363 >> v2:172.21.15.57:6801/2208289758 conn(0x7f0b0803ea40 0x7f0b08040f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:15.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.004+0000 7f0b217fa640 1 -- 172.21.15.57:0/1015991363 --> v2:172.21.15.57:6801/2208289758 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0b080415c0 con 0x7f0b0803ea40 2024-04-24T02:08:15.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.004+0000 7f0b217fa640 1 -- 172.21.15.57:0/1015991363 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=714) ==== 24+0+0 (crc 0 0 0) 0x7f0b18013e40 con 0x7f0b2409e750 2024-04-24T02:08:15.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.004+0000 7f0b23fff640 1 --2- 172.21.15.57:0/1015991363 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f0b08038980 0x7f0b0803ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:15.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.004+0000 7f0b23fff640 1 --2- 172.21.15.57:0/1015991363 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f0b08038980 0x7f0b0803ae90 crc :-1 s=READY pgs=3962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:15.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.005+0000 7f0b2973a640 1 --2- 172.21.15.57:0/1015991363 >> v2:172.21.15.57:6801/2208289758 conn(0x7f0b0803ea40 0x7f0b08040f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T02:08:15.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.008+0000 7f0b2973a640 1 --2- 172.21.15.57:0/1015991363 >> v2:172.21.15.57:6801/2208289758 conn(0x7f0b0803ea40 0x7f0b08040f30 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:15.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.010+0000 7f0b217fa640 1 -- 172.21.15.57:0/1015991363 <== osd.0 v2:172.21.15.57:6801/2208289758 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7f0b080415c0 con 0x7f0b0803ea40 2024-04-24T02:08:15.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.013+0000 7f0b2b19d640 1 -- 172.21.15.57:0/1015991363 --> v2:172.21.15.57:6801/2208289758 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0b24069330 con 0x7f0b0803ea40 2024-04-24T02:08:15.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.015+0000 7f0b217fa640 1 -- 172.21.15.57:0/1015991363 <== osd.0 v2:172.21.15.57:6801/2208289758 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f0b24069330 con 0x7f0b0803ea40 2024-04-24T02:08:15.016 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-24T02:08:15.016 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "" 2024-04-24T02:08:15.016 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-24T02:08:15.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.015+0000 7f0b2b19d640 1 -- 172.21.15.57:0/1015991363 >> v2:172.21.15.57:6801/2208289758 conn(0x7f0b0803ea40 msgr2=0x7f0b08040f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:15.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.015+0000 7f0b2b19d640 1 --2- 172.21.15.57:0/1015991363 >> v2:172.21.15.57:6801/2208289758 conn(0x7f0b0803ea40 0x7f0b08040f30 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:15.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.015+0000 7f0b2b19d640 1 -- 172.21.15.57:0/1015991363 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f0b08038980 msgr2=0x7f0b0803ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:15.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.015+0000 7f0b2b19d640 1 --2- 172.21.15.57:0/1015991363 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f0b08038980 0x7f0b0803ae90 crc :-1 s=READY pgs=3962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:15.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.015+0000 7f0b2b19d640 1 -- 172.21.15.57:0/1015991363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b2409e750 msgr2=0x7f0b2411e050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:15.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.015+0000 7f0b2b19d640 1 --2- 172.21.15.57:0/1015991363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b2409e750 0x7f0b2411e050 crc :-1 s=READY pgs=12977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:15.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.015+0000 7f0b2b19d640 1 -- 172.21.15.57:0/1015991363 shutdown_connections 2024-04-24T02:08:15.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.015+0000 7f0b2b19d640 1 --2- 172.21.15.57:0/1015991363 >> v2:172.21.15.57:6801/2208289758 conn(0x7f0b0803ea40 0x7f0b08040f30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:15.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.015+0000 7f0b2b19d640 1 --2- 172.21.15.57:0/1015991363 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f0b08038980 0x7f0b0803ae90 unknown :-1 s=CLOSED pgs=3962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:15.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.015+0000 7f0b2b19d640 1 --2- 172.21.15.57:0/1015991363 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b2409e750 0x7f0b2411e050 unknown :-1 s=CLOSED pgs=12977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:15.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.015+0000 7f0b2b19d640 1 -- 172.21.15.57:0/1015991363 >> 172.21.15.57:0/1015991363 conn(0x7f0b240a3d60 msgr2=0x7f0b241bcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:15.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.015+0000 7f0b2b19d640 1 -- 172.21.15.57:0/1015991363 shutdown_connections 2024-04-24T02:08:15.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.015+0000 7f0b2b19d640 1 -- 172.21.15.57:0/1015991363 wait complete. 2024-04-24T02:08:15.027 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-24T02:08:15.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.135+0000 7fd25c2ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:15.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.141+0000 7fd25c2ed640 1 Processor -- start 2024-04-24T02:08:15.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.141+0000 7fd25c2ed640 1 -- start start 2024-04-24T02:08:15.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.143+0000 7fd25c2ed640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd254132c10 0x7fd254133020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:15.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.143+0000 7fd25c2ed640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd254132800 con 0x7fd2540a0630 2024-04-24T02:08:15.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.143+0000 7fd25c2ed640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fd25409dcf0 con 0x7fd254132c10 2024-04-24T02:08:15.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.143+0000 7fd25a089640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd254132c10 0x7fd254133020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:15.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.143+0000 7fd259888640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd2540a0630 0x7fd2540a0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39820/0 (socket says 172.21.15.57:39820) 2024-04-24T02:08:15.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.143+0000 7fd259888640 1 -- 172.21.15.57:0/2631505799 learned_addr learned my addr 172.21.15.57:0/2631505799 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T02:08:15.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.143+0000 7fd25a089640 1 -- 172.21.15.57:0/2631505799 >> v1:172.21.15.57:6789/0 conn(0x7fd2540a0630 legacy=0x7fd2540a0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:15.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.143+0000 7fd25a089640 1 -- 172.21.15.57:0/2631505799 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd254073ba0 con 0x7fd254132c10 2024-04-24T02:08:15.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.144+0000 7fd25a089640 1 --2- 172.21.15.57:0/2631505799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd254132c10 0x7fd254133020 crc :-1 s=READY pgs=12979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c04f0b2e099ed9b server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:15.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.144+0000 7fd259087640 1 -- 172.21.15.57:0/2631505799 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd24400e040 con 0x7fd254132c10 2024-04-24T02:08:15.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.144+0000 7fd259087640 1 -- 172.21.15.57:0/2631505799 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd244007670 con 0x7fd254132c10 2024-04-24T02:08:15.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.144+0000 7fd259087640 1 -- 172.21.15.57:0/2631505799 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd244007910 con 0x7fd254132c10 2024-04-24T02:08:15.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.145+0000 7fd25c2ed640 1 -- 172.21.15.57:0/2631505799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd254132c10 msgr2=0x7fd254133020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:15.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.145+0000 7fd25c2ed640 1 --2- 172.21.15.57:0/2631505799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd254132c10 0x7fd254133020 crc :-1 s=READY pgs=12979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:15.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.145+0000 7fd25c2ed640 1 -- 172.21.15.57:0/2631505799 shutdown_connections 2024-04-24T02:08:15.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.145+0000 7fd25c2ed640 1 --2- 172.21.15.57:0/2631505799 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd254132c10 0x7fd254133020 unknown :-1 s=CLOSED pgs=12979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:15.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.145+0000 7fd25c2ed640 1 -- 172.21.15.57:0/2631505799 >> 172.21.15.57:0/2631505799 conn(0x7fd25409aa00 msgr2=0x7fd25409ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:15.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.145+0000 7fd25c2ed640 1 -- 172.21.15.57:0/2631505799 shutdown_connections 2024-04-24T02:08:15.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.145+0000 7fd25c2ed640 1 -- 172.21.15.57:0/2631505799 wait complete. 2024-04-24T02:08:15.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.145+0000 7fd25c2ed640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:15.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.147+0000 7fd25c2ed640 1 Processor -- start 2024-04-24T02:08:15.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.147+0000 7fd25c2ed640 1 -- start start 2024-04-24T02:08:15.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.148+0000 7fd25c2ed640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2540a0630 0x7fd25406d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:15.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.148+0000 7fd25c2ed640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd254121b90 con 0x7fd2540a0630 2024-04-24T02:08:15.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.148+0000 7fd25a089640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2540a0630 0x7fd25406d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:15.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.148+0000 7fd25a089640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2540a0630 0x7fd25406d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51762/0 (socket says 172.21.15.57:51762) 2024-04-24T02:08:15.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.148+0000 7fd25a089640 1 -- 172.21.15.57:0/3340282246 learned_addr learned my addr 172.21.15.57:0/3340282246 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:08:15.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.149+0000 7fd25a089640 1 -- 172.21.15.57:0/3340282246 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd254122110 con 0x7fd2540a0630 2024-04-24T02:08:15.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.149+0000 7fd25a089640 1 --2- 172.21.15.57:0/3340282246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2540a0630 0x7fd25406d9b0 crc :-1 s=READY pgs=12980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:15.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.149+0000 7fd252ffd640 1 -- 172.21.15.57:0/3340282246 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd24400e040 con 0x7fd2540a0630 2024-04-24T02:08:15.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.149+0000 7fd252ffd640 1 -- 172.21.15.57:0/3340282246 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fd244012a80 con 0x7fd2540a0630 2024-04-24T02:08:15.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.149+0000 7fd252ffd640 1 -- 172.21.15.57:0/3340282246 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fd244012d20 con 0x7fd2540a0630 2024-04-24T02:08:15.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.149+0000 7fd25c2ed640 1 -- 172.21.15.57:0/3340282246 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd254120cc0 con 0x7fd2540a0630 2024-04-24T02:08:15.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.149+0000 7fd25c2ed640 1 -- 172.21.15.57:0/3340282246 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd254121470 con 0x7fd2540a0630 2024-04-24T02:08:15.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.150+0000 7fd252ffd640 1 -- 172.21.15.57:0/3340282246 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fd2440153f0 con 0x7fd2540a0630 2024-04-24T02:08:15.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.150+0000 7fd252ffd640 1 --2- 172.21.15.57:0/3340282246 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fd240038980 0x7fd24003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:15.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.150+0000 7fd25c2ed640 1 -- 172.21.15.57:0/3340282246 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd254121920 con 0x7fd2540a0630 2024-04-24T02:08:15.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.150+0000 7fd252ffd640 1 -- 172.21.15.57:0/3340282246 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(714..714 src has 395..714) ==== 3403+0+0 (crc 0 0 0) 0x7fd244049ea0 con 0x7fd2540a0630 2024-04-24T02:08:15.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.150+0000 7fd259888640 1 --2- 172.21.15.57:0/3340282246 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fd240038980 0x7fd24003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:15.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.151+0000 7fd259888640 1 --2- 172.21.15.57:0/3340282246 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fd240038980 0x7fd24003ae90 crc :-1 s=READY pgs=3963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:15.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.156+0000 7fd252ffd640 1 -- 172.21.15.57:0/3340282246 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fd24400e1a0 con 0x7fd2540a0630 2024-04-24T02:08:15.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.343+0000 7fd25c2ed640 1 -- 172.21.15.57:0/3340282246 --> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fd254133560 con 0x7fd240038980 2024-04-24T02:08:15.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.344+0000 7fd252ffd640 1 -- 172.21.15.57:0/3340282246 <== mgr.4101 v2:172.21.15.84:6800/1747524692 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7fd248005930 con 0x7fd240038980 2024-04-24T02:08:15.345 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 0 to deep-scrub 2024-04-24T02:08:15.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.348+0000 7fd25c2ed640 1 -- 172.21.15.57:0/3340282246 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fd240038980 msgr2=0x7fd24003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:15.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.348+0000 7fd25c2ed640 1 --2- 172.21.15.57:0/3340282246 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fd240038980 0x7fd24003ae90 crc :-1 s=READY pgs=3963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:15.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.348+0000 7fd25c2ed640 1 -- 172.21.15.57:0/3340282246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2540a0630 msgr2=0x7fd25406d9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:15.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.348+0000 7fd25c2ed640 1 --2- 172.21.15.57:0/3340282246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2540a0630 0x7fd25406d9b0 crc :-1 s=READY pgs=12980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:15.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.348+0000 7fd25c2ed640 1 -- 172.21.15.57:0/3340282246 shutdown_connections 2024-04-24T02:08:15.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.348+0000 7fd25c2ed640 1 --2- 172.21.15.57:0/3340282246 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fd240038980 0x7fd24003ae90 unknown :-1 s=CLOSED pgs=3963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:15.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.348+0000 7fd25c2ed640 1 --2- 172.21.15.57:0/3340282246 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd2540a0630 0x7fd25406d9b0 unknown :-1 s=CLOSED pgs=12980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:15.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.348+0000 7fd25c2ed640 1 -- 172.21.15.57:0/3340282246 >> 172.21.15.57:0/3340282246 conn(0x7fd25409aa00 msgr2=0x7fd2541ba9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:15.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.348+0000 7fd25c2ed640 1 -- 172.21.15.57:0/3340282246 shutdown_connections 2024-04-24T02:08:15.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.348+0000 7fd25c2ed640 1 -- 172.21.15.57:0/3340282246 wait complete. 2024-04-24T02:08:15.368 INFO:tasks.ceph:Scrubbing osd.1 2024-04-24T02:08:15.368 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-24T02:08:15.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.481+0000 7f7784d5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:15.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.491+0000 7f7784d5d640 1 Processor -- start 2024-04-24T02:08:15.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.491+0000 7f7784d5d640 1 -- start start 2024-04-24T02:08:15.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.493+0000 7f7784d5d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7780137ca0 0x7f778013a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:15.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.493+0000 7f7784d5d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f778009de70 con 0x7f778009e750 2024-04-24T02:08:15.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.493+0000 7f7784d5d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f77800a0690 con 0x7f7780137ca0 2024-04-24T02:08:15.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.493+0000 7f777dd9b640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7780137ca0 0x7f778013a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:15.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.493+0000 7f777e59c640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f778009e750 0x7f77800a0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39822/0 (socket says 172.21.15.57:39822) 2024-04-24T02:08:15.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.493+0000 7f777e59c640 1 -- 172.21.15.57:0/4127449827 learned_addr learned my addr 172.21.15.57:0/4127449827 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T02:08:15.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.493+0000 7f777dd9b640 1 -- 172.21.15.57:0/4127449827 >> v1:172.21.15.57:6789/0 conn(0x7f778009e750 legacy=0x7f77800a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:15.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.493+0000 7f777dd9b640 1 -- 172.21.15.57:0/4127449827 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77800a0380 con 0x7f7780137ca0 2024-04-24T02:08:15.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.493+0000 7f777d59a640 1 -- 172.21.15.57:0/4127449827 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1834975029 0 0) 0x7f778009de70 con 0x7f778009e750 2024-04-24T02:08:15.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.493+0000 7f777dd9b640 1 --2- 172.21.15.57:0/4127449827 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7780137ca0 0x7f778013a0c0 crc :-1 s=READY pgs=12982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a56805a80e9cb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:15.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.493+0000 7f777d59a640 1 -- 172.21.15.57:0/4127449827 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7774009d90 con 0x7f7780137ca0 2024-04-24T02:08:15.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.493+0000 7f777d59a640 1 -- 172.21.15.57:0/4127449827 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f777400e230 con 0x7f7780137ca0 2024-04-24T02:08:15.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.493+0000 7f777d59a640 1 -- 172.21.15.57:0/4127449827 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f777400e4d0 con 0x7f7780137ca0 2024-04-24T02:08:15.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.494+0000 7f7784d5d640 1 -- 172.21.15.57:0/4127449827 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7780137ca0 msgr2=0x7f778013a0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:15.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.494+0000 7f7784d5d640 1 --2- 172.21.15.57:0/4127449827 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7780137ca0 0x7f778013a0c0 crc :-1 s=READY pgs=12982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:15.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.494+0000 7f7784d5d640 1 -- 172.21.15.57:0/4127449827 shutdown_connections 2024-04-24T02:08:15.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.494+0000 7f7784d5d640 1 --2- 172.21.15.57:0/4127449827 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7780137ca0 0x7f778013a0c0 unknown :-1 s=CLOSED pgs=12982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:15.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.494+0000 7f7784d5d640 1 -- 172.21.15.57:0/4127449827 >> 172.21.15.57:0/4127449827 conn(0x7f77800a3d60 msgr2=0x7f77800a4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:15.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.494+0000 7f7784d5d640 1 -- 172.21.15.57:0/4127449827 shutdown_connections 2024-04-24T02:08:15.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.494+0000 7f7784d5d640 1 -- 172.21.15.57:0/4127449827 wait complete. 2024-04-24T02:08:15.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.495+0000 7f7784d5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:15.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.496+0000 7f7784d5d640 1 Processor -- start 2024-04-24T02:08:15.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.496+0000 7f7784d5d640 1 -- start start 2024-04-24T02:08:15.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.498+0000 7f7784d5d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f778009e750 0x7f77801c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:15.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.498+0000 7f7784d5d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f77801324d0 con 0x7f778009e750 2024-04-24T02:08:15.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.498+0000 7f777e59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f778009e750 0x7f77801c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:15.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.498+0000 7f777e59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f778009e750 0x7f77801c6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51792/0 (socket says 172.21.15.57:51792) 2024-04-24T02:08:15.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.498+0000 7f777e59c640 1 -- 172.21.15.57:0/2233574819 learned_addr learned my addr 172.21.15.57:0/2233574819 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:08:15.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.498+0000 7f777e59c640 1 -- 172.21.15.57:0/2233574819 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7780120ac0 con 0x7f778009e750 2024-04-24T02:08:15.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.499+0000 7f777e59c640 1 --2- 172.21.15.57:0/2233574819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f778009e750 0x7f77801c6370 crc :-1 s=READY pgs=12983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:15.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.499+0000 7f776effd640 1 -- 172.21.15.57:0/2233574819 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7770004b80 con 0x7f778009e750 2024-04-24T02:08:15.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.499+0000 7f776effd640 1 -- 172.21.15.57:0/2233574819 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f7770004ce0 con 0x7f778009e750 2024-04-24T02:08:15.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.499+0000 7f7784d5d640 1 -- 172.21.15.57:0/2233574819 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77801213a0 con 0x7f778009e750 2024-04-24T02:08:15.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.499+0000 7f776effd640 1 -- 172.21.15.57:0/2233574819 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f7770007120 con 0x7f778009e750 2024-04-24T02:08:15.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.499+0000 7f7784d5d640 1 -- 172.21.15.57:0/2233574819 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7780122ac0 con 0x7f778009e750 2024-04-24T02:08:15.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.499+0000 7f7784d5d640 1 -- 172.21.15.57:0/2233574819 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7780121c20 con 0x7f778009e750 2024-04-24T02:08:15.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.500+0000 7f776effd640 1 -- 172.21.15.57:0/2233574819 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f77700072d0 con 0x7f778009e750 2024-04-24T02:08:15.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.500+0000 7f776effd640 1 --2- 172.21.15.57:0/2233574819 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f7760038980 0x7f776003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:15.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.500+0000 7f776effd640 1 -- 172.21.15.57:0/2233574819 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(714..714 src has 395..714) ==== 3403+0+0 (crc 0 0 0) 0x7f7770048520 con 0x7f778009e750 2024-04-24T02:08:15.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.500+0000 7f776effd640 1 --2- 172.21.15.57:0/2233574819 >> v2:172.21.15.57:6805/2600611357 conn(0x7f776003eaa0 0x7f7760040f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:15.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.500+0000 7f776effd640 1 -- 172.21.15.57:0/2233574819 --> v2:172.21.15.57:6805/2600611357 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7760041620 con 0x7f776003eaa0 2024-04-24T02:08:15.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.500+0000 7f776effd640 1 -- 172.21.15.57:0/2233574819 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=714) ==== 24+0+0 (crc 0 0 0) 0x7f777004a990 con 0x7f778009e750 2024-04-24T02:08:15.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.500+0000 7f777dd9b640 1 --2- 172.21.15.57:0/2233574819 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f7760038980 0x7f776003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:15.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.501+0000 7f777dd9b640 1 --2- 172.21.15.57:0/2233574819 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f7760038980 0x7f776003ae90 crc :-1 s=READY pgs=3964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:15.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.501+0000 7f777ed9d640 1 --2- 172.21.15.57:0/2233574819 >> v2:172.21.15.57:6805/2600611357 conn(0x7f776003eaa0 0x7f7760040f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T02:08:15.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.503+0000 7f777ed9d640 1 --2- 172.21.15.57:0/2233574819 >> v2:172.21.15.57:6805/2600611357 conn(0x7f776003eaa0 0x7f7760040f90 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:15.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.504+0000 7f776effd640 1 -- 172.21.15.57:0/2233574819 <== osd.1 v2:172.21.15.57:6805/2600611357 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7f7760041620 con 0x7f776003eaa0 2024-04-24T02:08:15.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.508+0000 7f7784d5d640 1 -- 172.21.15.57:0/2233574819 --> v2:172.21.15.57:6805/2600611357 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f778009f3c0 con 0x7f776003eaa0 2024-04-24T02:08:15.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.509+0000 7f776effd640 1 -- 172.21.15.57:0/2233574819 <== osd.1 v2:172.21.15.57:6805/2600611357 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f777800a820 con 0x7f776003eaa0 2024-04-24T02:08:15.510 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-24T02:08:15.510 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "" 2024-04-24T02:08:15.511 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-24T02:08:15.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.509+0000 7f7784d5d640 1 -- 172.21.15.57:0/2233574819 >> v2:172.21.15.57:6805/2600611357 conn(0x7f776003eaa0 msgr2=0x7f7760040f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:15.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.509+0000 7f7784d5d640 1 --2- 172.21.15.57:0/2233574819 >> v2:172.21.15.57:6805/2600611357 conn(0x7f776003eaa0 0x7f7760040f90 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:15.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.509+0000 7f7784d5d640 1 -- 172.21.15.57:0/2233574819 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f7760038980 msgr2=0x7f776003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:15.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.509+0000 7f7784d5d640 1 --2- 172.21.15.57:0/2233574819 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f7760038980 0x7f776003ae90 crc :-1 s=READY pgs=3964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:15.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.509+0000 7f7784d5d640 1 -- 172.21.15.57:0/2233574819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f778009e750 msgr2=0x7f77801c6370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:15.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.509+0000 7f7784d5d640 1 --2- 172.21.15.57:0/2233574819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f778009e750 0x7f77801c6370 crc :-1 s=READY pgs=12983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:15.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.509+0000 7f7784d5d640 1 -- 172.21.15.57:0/2233574819 shutdown_connections 2024-04-24T02:08:15.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.509+0000 7f7784d5d640 1 --2- 172.21.15.57:0/2233574819 >> v2:172.21.15.57:6805/2600611357 conn(0x7f776003eaa0 0x7f7760040f90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:15.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.509+0000 7f7784d5d640 1 --2- 172.21.15.57:0/2233574819 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f7760038980 0x7f776003ae90 unknown :-1 s=CLOSED pgs=3964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:15.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.509+0000 7f7784d5d640 1 --2- 172.21.15.57:0/2233574819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f778009e750 0x7f77801c6370 unknown :-1 s=CLOSED pgs=12983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:15.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.510+0000 7f7784d5d640 1 -- 172.21.15.57:0/2233574819 >> 172.21.15.57:0/2233574819 conn(0x7f77800a3d60 msgr2=0x7f778009ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:15.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.510+0000 7f7784d5d640 1 -- 172.21.15.57:0/2233574819 shutdown_connections 2024-04-24T02:08:15.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.510+0000 7f7784d5d640 1 -- 172.21.15.57:0/2233574819 wait complete. 2024-04-24T02:08:15.522 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-24T02:08:15.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.629+0000 7fb7e7ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:15.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.635+0000 7fb7e7ead640 1 Processor -- start 2024-04-24T02:08:15.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.635+0000 7fb7e7ead640 1 -- start start 2024-04-24T02:08:15.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.637+0000 7fb7e7ead640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb7e0135a70 0x7fb7e0137e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:15.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.637+0000 7fb7e7ead640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7e0132800 con 0x7fb7e0132c10 2024-04-24T02:08:15.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.637+0000 7fb7e7ead640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fb7e009dcf0 con 0x7fb7e0135a70 2024-04-24T02:08:15.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.637+0000 7fb7e5448640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb7e0135a70 0x7fb7e0137e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:15.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.637+0000 7fb7e5c49640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb7e0132c10 0x7fb7e0133020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39834/0 (socket says 172.21.15.57:39834) 2024-04-24T02:08:15.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.637+0000 7fb7e5c49640 1 -- 172.21.15.57:0/1152491010 learned_addr learned my addr 172.21.15.57:0/1152491010 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T02:08:15.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.637+0000 7fb7e5448640 1 -- 172.21.15.57:0/1152491010 >> v1:172.21.15.57:6789/0 conn(0x7fb7e0132c10 legacy=0x7fb7e0133020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:15.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.637+0000 7fb7e5448640 1 -- 172.21.15.57:0/1152491010 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e0073ba0 con 0x7fb7e0135a70 2024-04-24T02:08:15.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.637+0000 7fb7e4c47640 1 -- 172.21.15.57:0/1152491010 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1970542990 0 0) 0x7fb7e0132800 con 0x7fb7e0132c10 2024-04-24T02:08:15.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.637+0000 7fb7e5448640 1 --2- 172.21.15.57:0/1152491010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7e0135a70 0x7fb7e0137e90 crc :-1 s=READY pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b5042f657937e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:15.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.637+0000 7fb7e4c47640 1 -- 172.21.15.57:0/1152491010 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb7d0009d90 con 0x7fb7e0135a70 2024-04-24T02:08:15.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.638+0000 7fb7e4c47640 1 -- 172.21.15.57:0/1152491010 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb7d000e230 con 0x7fb7e0135a70 2024-04-24T02:08:15.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.638+0000 7fb7e4c47640 1 -- 172.21.15.57:0/1152491010 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb7d000e4d0 con 0x7fb7e0135a70 2024-04-24T02:08:15.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.638+0000 7fb7e7ead640 1 -- 172.21.15.57:0/1152491010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7e0135a70 msgr2=0x7fb7e0137e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:15.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.638+0000 7fb7e7ead640 1 --2- 172.21.15.57:0/1152491010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7e0135a70 0x7fb7e0137e90 crc :-1 s=READY pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:15.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.638+0000 7fb7e7ead640 1 -- 172.21.15.57:0/1152491010 shutdown_connections 2024-04-24T02:08:15.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.638+0000 7fb7e7ead640 1 --2- 172.21.15.57:0/1152491010 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7e0135a70 0x7fb7e0137e90 unknown :-1 s=CLOSED pgs=12985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:15.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.638+0000 7fb7e7ead640 1 -- 172.21.15.57:0/1152491010 >> 172.21.15.57:0/1152491010 conn(0x7fb7e009aa00 msgr2=0x7fb7e009ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:15.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.638+0000 7fb7e7ead640 1 -- 172.21.15.57:0/1152491010 shutdown_connections 2024-04-24T02:08:15.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.638+0000 7fb7e7ead640 1 -- 172.21.15.57:0/1152491010 wait complete. 2024-04-24T02:08:15.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.639+0000 7fb7e7ead640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:15.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.640+0000 7fb7e7ead640 1 Processor -- start 2024-04-24T02:08:15.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.640+0000 7fb7e7ead640 1 -- start start 2024-04-24T02:08:15.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.642+0000 7fb7e7ead640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7e0132c10 0x7fb7e011d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:15.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.642+0000 7fb7e7ead640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e011e720 con 0x7fb7e0132c10 2024-04-24T02:08:15.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.642+0000 7fb7e5c49640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7e0132c10 0x7fb7e011d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:15.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.642+0000 7fb7e5c49640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7e0132c10 0x7fb7e011d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51812/0 (socket says 172.21.15.57:51812) 2024-04-24T02:08:15.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.642+0000 7fb7e5c49640 1 -- 172.21.15.57:0/1441204836 learned_addr learned my addr 172.21.15.57:0/1441204836 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:08:15.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.642+0000 7fb7e5c49640 1 -- 172.21.15.57:0/1441204836 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e011cfc0 con 0x7fb7e0132c10 2024-04-24T02:08:15.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.643+0000 7fb7e5c49640 1 --2- 172.21.15.57:0/1441204836 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7e0132c10 0x7fb7e011d450 crc :-1 s=READY pgs=12986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:15.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.643+0000 7fb7d67fc640 1 -- 172.21.15.57:0/1441204836 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb7dc004b80 con 0x7fb7e0132c10 2024-04-24T02:08:15.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.643+0000 7fb7d67fc640 1 -- 172.21.15.57:0/1441204836 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fb7dc004ce0 con 0x7fb7e0132c10 2024-04-24T02:08:15.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.643+0000 7fb7e7ead640 1 -- 172.21.15.57:0/1441204836 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7e011fe40 con 0x7fb7e0132c10 2024-04-24T02:08:15.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.643+0000 7fb7d67fc640 1 -- 172.21.15.57:0/1441204836 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fb7dc007120 con 0x7fb7e0132c10 2024-04-24T02:08:15.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.643+0000 7fb7e7ead640 1 -- 172.21.15.57:0/1441204836 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7e01207e0 con 0x7fb7e0132c10 2024-04-24T02:08:15.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.644+0000 7fb7d67fc640 1 -- 172.21.15.57:0/1441204836 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fb7dc0072d0 con 0x7fb7e0132c10 2024-04-24T02:08:15.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.644+0000 7fb7e7ead640 1 -- 172.21.15.57:0/1441204836 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7e011efe0 con 0x7fb7e0132c10 2024-04-24T02:08:15.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.644+0000 7fb7d67fc640 1 --2- 172.21.15.57:0/1441204836 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fb7c4038980 0x7fb7c403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:15.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.644+0000 7fb7d67fc640 1 -- 172.21.15.57:0/1441204836 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(714..714 src has 395..714) ==== 3403+0+0 (crc 0 0 0) 0x7fb7dc048660 con 0x7fb7e0132c10 2024-04-24T02:08:15.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.644+0000 7fb7e5448640 1 --2- 172.21.15.57:0/1441204836 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fb7c4038980 0x7fb7c403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:15.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.645+0000 7fb7e5448640 1 --2- 172.21.15.57:0/1441204836 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fb7c4038980 0x7fb7c403ae90 crc :-1 s=READY pgs=3965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:15.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.649+0000 7fb7d67fc640 1 -- 172.21.15.57:0/1441204836 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fb7dc00a9e0 con 0x7fb7e0132c10 2024-04-24T02:08:15.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.838+0000 7fb7e7ead640 1 -- 172.21.15.57:0/1441204836 --> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fb7e0120d40 con 0x7fb7c4038980 2024-04-24T02:08:15.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.839+0000 7fb7d67fc640 1 -- 172.21.15.57:0/1441204836 <== mgr.4101 v2:172.21.15.84:6800/1747524692 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7fb7e0120d40 con 0x7fb7c4038980 2024-04-24T02:08:15.841 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 1 to deep-scrub 2024-04-24T02:08:15.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.842+0000 7fb7e7ead640 1 -- 172.21.15.57:0/1441204836 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fb7c4038980 msgr2=0x7fb7c403ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:15.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.842+0000 7fb7e7ead640 1 --2- 172.21.15.57:0/1441204836 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fb7c4038980 0x7fb7c403ae90 crc :-1 s=READY pgs=3965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:15.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.842+0000 7fb7e7ead640 1 -- 172.21.15.57:0/1441204836 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7e0132c10 msgr2=0x7fb7e011d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:15.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.842+0000 7fb7e7ead640 1 --2- 172.21.15.57:0/1441204836 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7e0132c10 0x7fb7e011d450 crc :-1 s=READY pgs=12986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:15.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.842+0000 7fb7e7ead640 1 -- 172.21.15.57:0/1441204836 shutdown_connections 2024-04-24T02:08:15.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.842+0000 7fb7e7ead640 1 --2- 172.21.15.57:0/1441204836 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fb7c4038980 0x7fb7c403ae90 unknown :-1 s=CLOSED pgs=3965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:15.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.842+0000 7fb7e7ead640 1 --2- 172.21.15.57:0/1441204836 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7e0132c10 0x7fb7e011d450 unknown :-1 s=CLOSED pgs=12986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:15.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.842+0000 7fb7e7ead640 1 -- 172.21.15.57:0/1441204836 >> 172.21.15.57:0/1441204836 conn(0x7fb7e009aa00 msgr2=0x7fb7e00a2a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:15.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.842+0000 7fb7e7ead640 1 -- 172.21.15.57:0/1441204836 shutdown_connections 2024-04-24T02:08:15.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.842+0000 7fb7e7ead640 1 -- 172.21.15.57:0/1441204836 wait complete. 2024-04-24T02:08:15.862 INFO:tasks.ceph:Scrubbing osd.2 2024-04-24T02:08:15.862 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-24T02:08:15.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.970+0000 7f946255d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:15.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.980+0000 7f946255d640 1 Processor -- start 2024-04-24T02:08:15.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.980+0000 7f946255d640 1 -- start start 2024-04-24T02:08:15.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.981+0000 7f946255d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f945c137ca0 0x7f945c13a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:15.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.981+0000 7f946255d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f945c09de70 con 0x7f945c09e750 2024-04-24T02:08:15.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.981+0000 7f946255d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f945c0a0690 con 0x7f945c137ca0 2024-04-24T02:08:15.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.982+0000 7f945b7fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f945c137ca0 0x7f945c13a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:15.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.982+0000 7f945bfff640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f945c09e750 0x7f945c0a0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39838/0 (socket says 172.21.15.57:39838) 2024-04-24T02:08:15.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.982+0000 7f945bfff640 1 -- 172.21.15.57:0/839212289 learned_addr learned my addr 172.21.15.57:0/839212289 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T02:08:15.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.982+0000 7f945b7fe640 1 -- 172.21.15.57:0/839212289 >> v1:172.21.15.57:6789/0 conn(0x7f945c09e750 legacy=0x7f945c0a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:15.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.982+0000 7f945b7fe640 1 -- 172.21.15.57:0/839212289 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f945c0a0380 con 0x7f945c137ca0 2024-04-24T02:08:15.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.982+0000 7f945b7fe640 1 --2- 172.21.15.57:0/839212289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f945c137ca0 0x7f945c13a0c0 crc :-1 s=READY pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b470dfbdeda2c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:15.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.982+0000 7f945affd640 1 -- 172.21.15.57:0/839212289 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f9444009d90 con 0x7f945c137ca0 2024-04-24T02:08:15.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.982+0000 7f945affd640 1 -- 172.21.15.57:0/839212289 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f944400e230 con 0x7f945c137ca0 2024-04-24T02:08:15.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.982+0000 7f945affd640 1 -- 172.21.15.57:0/839212289 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f944400e4d0 con 0x7f945c137ca0 2024-04-24T02:08:15.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.983+0000 7f946255d640 1 -- 172.21.15.57:0/839212289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f945c137ca0 msgr2=0x7f945c13a0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:15.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.983+0000 7f946255d640 1 --2- 172.21.15.57:0/839212289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f945c137ca0 0x7f945c13a0c0 crc :-1 s=READY pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:15.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.983+0000 7f946255d640 1 -- 172.21.15.57:0/839212289 shutdown_connections 2024-04-24T02:08:15.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.983+0000 7f946255d640 1 --2- 172.21.15.57:0/839212289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f945c137ca0 0x7f945c13a0c0 unknown :-1 s=CLOSED pgs=12988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:15.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.983+0000 7f946255d640 1 -- 172.21.15.57:0/839212289 >> 172.21.15.57:0/839212289 conn(0x7f945c0a3d60 msgr2=0x7f945c0a4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:15.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.983+0000 7f946255d640 1 -- 172.21.15.57:0/839212289 shutdown_connections 2024-04-24T02:08:15.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.983+0000 7f946255d640 1 -- 172.21.15.57:0/839212289 wait complete. 2024-04-24T02:08:15.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.983+0000 7f946255d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:15.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.985+0000 7f946255d640 1 Processor -- start 2024-04-24T02:08:15.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.985+0000 7f946255d640 1 -- start start 2024-04-24T02:08:15.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.987+0000 7f946255d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f945c09e750 0x7f945c1c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:15.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.987+0000 7f946255d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f945c1218b0 con 0x7f945c09e750 2024-04-24T02:08:15.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.987+0000 7f945bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f945c09e750 0x7f945c1c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:15.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.987+0000 7f945bfff640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f945c09e750 0x7f945c1c9bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51822/0 (socket says 172.21.15.57:51822) 2024-04-24T02:08:15.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.987+0000 7f945bfff640 1 -- 172.21.15.57:0/460788273 learned_addr learned my addr 172.21.15.57:0/460788273 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:08:15.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.987+0000 7f945bfff640 1 -- 172.21.15.57:0/460788273 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f945c121d10 con 0x7f945c09e750 2024-04-24T02:08:15.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.987+0000 7f945bfff640 1 --2- 172.21.15.57:0/460788273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f945c09e750 0x7f945c1c9bc0 crc :-1 s=READY pgs=12989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:15.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.987+0000 7f9458ff9640 1 -- 172.21.15.57:0/460788273 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f944c005a60 con 0x7f945c09e750 2024-04-24T02:08:15.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.987+0000 7f9458ff9640 1 -- 172.21.15.57:0/460788273 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f944c005bc0 con 0x7f945c09e750 2024-04-24T02:08:15.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.988+0000 7f9458ff9640 1 -- 172.21.15.57:0/460788273 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f944c005e60 con 0x7f945c09e750 2024-04-24T02:08:15.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.988+0000 7f946255d640 1 -- 172.21.15.57:0/460788273 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f945c1c9820 con 0x7f945c09e750 2024-04-24T02:08:15.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.988+0000 7f946255d640 1 -- 172.21.15.57:0/460788273 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f945c1c9430 con 0x7f945c09e750 2024-04-24T02:08:15.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.988+0000 7f946255d640 1 -- 172.21.15.57:0/460788273 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f945c1231b0 con 0x7f945c09e750 2024-04-24T02:08:15.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.989+0000 7f9458ff9640 1 -- 172.21.15.57:0/460788273 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f944c0070b0 con 0x7f945c09e750 2024-04-24T02:08:15.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.989+0000 7f9458ff9640 1 --2- 172.21.15.57:0/460788273 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f943c038980 0x7f943c03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:15.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.989+0000 7f9458ff9640 1 -- 172.21.15.57:0/460788273 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(714..714 src has 395..714) ==== 3403+0+0 (crc 0 0 0) 0x7f944c048470 con 0x7f945c09e750 2024-04-24T02:08:15.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.989+0000 7f9458ff9640 1 --2- 172.21.15.57:0/460788273 >> v2:172.21.15.84:6805/1003835807 conn(0x7f943c03ea40 0x7f943c040f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:15.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.989+0000 7f9458ff9640 1 -- 172.21.15.57:0/460788273 --> v2:172.21.15.84:6805/1003835807 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f943c0415c0 con 0x7f943c03ea40 2024-04-24T02:08:15.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.989+0000 7f9458ff9640 1 -- 172.21.15.57:0/460788273 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=714) ==== 24+0+0 (crc 0 0 0) 0x7f944c04a960 con 0x7f945c09e750 2024-04-24T02:08:15.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.989+0000 7f945b7fe640 1 --2- 172.21.15.57:0/460788273 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f943c038980 0x7f943c03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:15.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.990+0000 7f945b7fe640 1 --2- 172.21.15.57:0/460788273 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f943c038980 0x7f943c03ae90 crc :-1 s=READY pgs=3966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:15.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.990+0000 7f9460afa640 1 --2- 172.21.15.57:0/460788273 >> v2:172.21.15.84:6805/1003835807 conn(0x7f943c03ea40 0x7f943c040f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T02:08:15.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.993+0000 7f9460afa640 1 --2- 172.21.15.57:0/460788273 >> v2:172.21.15.84:6805/1003835807 conn(0x7f943c03ea40 0x7f943c040f30 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:15.996 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.995+0000 7f9458ff9640 1 -- 172.21.15.57:0/460788273 <== osd.2 v2:172.21.15.84:6805/1003835807 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7f943c0415c0 con 0x7f943c03ea40 2024-04-24T02:08:15.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:15.998+0000 7f946255d640 1 -- 172.21.15.57:0/460788273 --> v2:172.21.15.84:6805/1003835807 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f945c09f3c0 con 0x7f943c03ea40 2024-04-24T02:08:16.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.000+0000 7f9458ff9640 1 -- 172.21.15.57:0/460788273 <== osd.2 v2:172.21.15.84:6805/1003835807 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f945400a820 con 0x7f943c03ea40 2024-04-24T02:08:16.001 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-24T02:08:16.001 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "" 2024-04-24T02:08:16.001 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-24T02:08:16.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.000+0000 7f946255d640 1 -- 172.21.15.57:0/460788273 >> v2:172.21.15.84:6805/1003835807 conn(0x7f943c03ea40 msgr2=0x7f943c040f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:16.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.000+0000 7f946255d640 1 --2- 172.21.15.57:0/460788273 >> v2:172.21.15.84:6805/1003835807 conn(0x7f943c03ea40 0x7f943c040f30 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:16.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.000+0000 7f946255d640 1 -- 172.21.15.57:0/460788273 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f943c038980 msgr2=0x7f943c03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:16.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.000+0000 7f946255d640 1 --2- 172.21.15.57:0/460788273 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f943c038980 0x7f943c03ae90 crc :-1 s=READY pgs=3966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:16.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.000+0000 7f946255d640 1 -- 172.21.15.57:0/460788273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f945c09e750 msgr2=0x7f945c1c9bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:16.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.000+0000 7f946255d640 1 --2- 172.21.15.57:0/460788273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f945c09e750 0x7f945c1c9bc0 crc :-1 s=READY pgs=12989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:16.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.000+0000 7f946255d640 1 -- 172.21.15.57:0/460788273 shutdown_connections 2024-04-24T02:08:16.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.000+0000 7f946255d640 1 --2- 172.21.15.57:0/460788273 >> v2:172.21.15.84:6805/1003835807 conn(0x7f943c03ea40 0x7f943c040f30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:16.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.000+0000 7f946255d640 1 --2- 172.21.15.57:0/460788273 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f943c038980 0x7f943c03ae90 unknown :-1 s=CLOSED pgs=3966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:16.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.000+0000 7f946255d640 1 --2- 172.21.15.57:0/460788273 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f945c09e750 0x7f945c1c9bc0 unknown :-1 s=CLOSED pgs=12989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:16.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.000+0000 7f946255d640 1 -- 172.21.15.57:0/460788273 >> 172.21.15.57:0/460788273 conn(0x7f945c0a3d60 msgr2=0x7f945c0a5890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:16.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.000+0000 7f946255d640 1 -- 172.21.15.57:0/460788273 shutdown_connections 2024-04-24T02:08:16.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.000+0000 7f946255d640 1 -- 172.21.15.57:0/460788273 wait complete. 2024-04-24T02:08:16.013 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-24T02:08:16.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.122+0000 7fce46b5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:16.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.129+0000 7fce46b5d640 1 Processor -- start 2024-04-24T02:08:16.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.129+0000 7fce46b5d640 1 -- start start 2024-04-24T02:08:16.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.130+0000 7fce46b5d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fce40135a70 0x7fce40137e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:16.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.130+0000 7fce46b5d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce40132800 con 0x7fce40132c10 2024-04-24T02:08:16.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.130+0000 7fce46b5d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fce4009dcf0 con 0x7fce40135a70 2024-04-24T02:08:16.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.130+0000 7fce3ffff640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fce40135a70 0x7fce40137e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:16.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.130+0000 7fce448f9640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fce40132c10 0x7fce40133020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39852/0 (socket says 172.21.15.57:39852) 2024-04-24T02:08:16.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.130+0000 7fce448f9640 1 -- 172.21.15.57:0/204363985 learned_addr learned my addr 172.21.15.57:0/204363985 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T02:08:16.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.131+0000 7fce3ffff640 1 -- 172.21.15.57:0/204363985 >> v1:172.21.15.57:6789/0 conn(0x7fce40132c10 legacy=0x7fce40133020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:16.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.131+0000 7fce3ffff640 1 -- 172.21.15.57:0/204363985 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce40073ba0 con 0x7fce40135a70 2024-04-24T02:08:16.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.131+0000 7fce3ffff640 1 --2- 172.21.15.57:0/204363985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce40135a70 0x7fce40137e90 crc :-1 s=READY pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1057177f4a6fe0d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:16.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.131+0000 7fce3f7fe640 1 -- 172.21.15.57:0/204363985 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fce34009d90 con 0x7fce40135a70 2024-04-24T02:08:16.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.131+0000 7fce3f7fe640 1 -- 172.21.15.57:0/204363985 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fce3400e230 con 0x7fce40135a70 2024-04-24T02:08:16.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.131+0000 7fce3f7fe640 1 -- 172.21.15.57:0/204363985 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fce3400e4d0 con 0x7fce40135a70 2024-04-24T02:08:16.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.132+0000 7fce46b5d640 1 -- 172.21.15.57:0/204363985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce40135a70 msgr2=0x7fce40137e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:16.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.132+0000 7fce46b5d640 1 --2- 172.21.15.57:0/204363985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce40135a70 0x7fce40137e90 crc :-1 s=READY pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:16.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.132+0000 7fce46b5d640 1 -- 172.21.15.57:0/204363985 shutdown_connections 2024-04-24T02:08:16.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.132+0000 7fce46b5d640 1 --2- 172.21.15.57:0/204363985 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce40135a70 0x7fce40137e90 unknown :-1 s=CLOSED pgs=12991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:16.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.132+0000 7fce46b5d640 1 -- 172.21.15.57:0/204363985 >> 172.21.15.57:0/204363985 conn(0x7fce4009aa00 msgr2=0x7fce4009ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:16.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.132+0000 7fce46b5d640 1 -- 172.21.15.57:0/204363985 shutdown_connections 2024-04-24T02:08:16.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.132+0000 7fce46b5d640 1 -- 172.21.15.57:0/204363985 wait complete. 2024-04-24T02:08:16.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.132+0000 7fce46b5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:16.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.136+0000 7fce46b5d640 1 Processor -- start 2024-04-24T02:08:16.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.136+0000 7fce46b5d640 1 -- start start 2024-04-24T02:08:16.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.138+0000 7fce46b5d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce40132c10 0x7fce4006d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:16.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.138+0000 7fce46b5d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fce40122050 con 0x7fce40132c10 2024-04-24T02:08:16.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.138+0000 7fce448f9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce40132c10 0x7fce4006d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:16.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.138+0000 7fce448f9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce40132c10 0x7fce4006d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51828/0 (socket says 172.21.15.57:51828) 2024-04-24T02:08:16.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.138+0000 7fce448f9640 1 -- 172.21.15.57:0/375665148 learned_addr learned my addr 172.21.15.57:0/375665148 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:08:16.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.138+0000 7fce448f9640 1 -- 172.21.15.57:0/375665148 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce4006f580 con 0x7fce40132c10 2024-04-24T02:08:16.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.139+0000 7fce448f9640 1 --2- 172.21.15.57:0/375665148 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce40132c10 0x7fce4006d9a0 crc :-1 s=READY pgs=12992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:16.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.139+0000 7fce3d7fa640 1 -- 172.21.15.57:0/375665148 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fce380070b0 con 0x7fce40132c10 2024-04-24T02:08:16.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.139+0000 7fce3d7fa640 1 -- 172.21.15.57:0/375665148 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fce38007210 con 0x7fce40132c10 2024-04-24T02:08:16.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.139+0000 7fce46b5d640 1 -- 172.21.15.57:0/375665148 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce40130000 con 0x7fce40132c10 2024-04-24T02:08:16.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.139+0000 7fce3d7fa640 1 -- 172.21.15.57:0/375665148 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fce380074b0 con 0x7fce40132c10 2024-04-24T02:08:16.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.139+0000 7fce46b5d640 1 -- 172.21.15.57:0/375665148 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce401219f0 con 0x7fce40132c10 2024-04-24T02:08:16.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.140+0000 7fce3d7fa640 1 -- 172.21.15.57:0/375665148 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fce380076a0 con 0x7fce40132c10 2024-04-24T02:08:16.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.140+0000 7fce46b5d640 1 -- 172.21.15.57:0/375665148 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce401301f0 con 0x7fce40132c10 2024-04-24T02:08:16.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.140+0000 7fce3d7fa640 1 --2- 172.21.15.57:0/375665148 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fce2c038980 0x7fce2c03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:16.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.140+0000 7fce3d7fa640 1 -- 172.21.15.57:0/375665148 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(714..714 src has 395..714) ==== 3403+0+0 (crc 0 0 0) 0x7fce38048e50 con 0x7fce40132c10 2024-04-24T02:08:16.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.141+0000 7fce3ffff640 1 --2- 172.21.15.57:0/375665148 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fce2c038980 0x7fce2c03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:16.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.141+0000 7fce3ffff640 1 --2- 172.21.15.57:0/375665148 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fce2c038980 0x7fce2c03ae90 crc :-1 s=READY pgs=3967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:16.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.145+0000 7fce3d7fa640 1 -- 172.21.15.57:0/375665148 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fce380094a0 con 0x7fce40132c10 2024-04-24T02:08:16.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.330+0000 7fce46b5d640 1 -- 172.21.15.57:0/375665148 --> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fce401230b0 con 0x7fce2c038980 2024-04-24T02:08:16.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.331+0000 7fce3d7fa640 1 -- 172.21.15.57:0/375665148 <== mgr.4101 v2:172.21.15.84:6800/1747524692 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7fce401230b0 con 0x7fce2c038980 2024-04-24T02:08:16.332 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 2 to deep-scrub 2024-04-24T02:08:16.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.333+0000 7fce46b5d640 1 -- 172.21.15.57:0/375665148 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fce2c038980 msgr2=0x7fce2c03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:16.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.333+0000 7fce46b5d640 1 --2- 172.21.15.57:0/375665148 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fce2c038980 0x7fce2c03ae90 crc :-1 s=READY pgs=3967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:16.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.333+0000 7fce46b5d640 1 -- 172.21.15.57:0/375665148 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce40132c10 msgr2=0x7fce4006d9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:16.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.333+0000 7fce46b5d640 1 --2- 172.21.15.57:0/375665148 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce40132c10 0x7fce4006d9a0 crc :-1 s=READY pgs=12992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:16.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.333+0000 7fce46b5d640 1 -- 172.21.15.57:0/375665148 shutdown_connections 2024-04-24T02:08:16.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.333+0000 7fce46b5d640 1 --2- 172.21.15.57:0/375665148 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fce2c038980 0x7fce2c03ae90 unknown :-1 s=CLOSED pgs=3967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:16.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.333+0000 7fce46b5d640 1 --2- 172.21.15.57:0/375665148 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce40132c10 0x7fce4006d9a0 unknown :-1 s=CLOSED pgs=12992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:16.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.333+0000 7fce46b5d640 1 -- 172.21.15.57:0/375665148 >> 172.21.15.57:0/375665148 conn(0x7fce4009aa00 msgr2=0x7fce4009f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:16.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.333+0000 7fce46b5d640 1 -- 172.21.15.57:0/375665148 shutdown_connections 2024-04-24T02:08:16.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.333+0000 7fce46b5d640 1 -- 172.21.15.57:0/375665148 wait complete. 2024-04-24T02:08:16.347 INFO:tasks.ceph:Scrubbing osd.3 2024-04-24T02:08:16.347 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-24T02:08:16.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.452+0000 7f395462d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:16.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.462+0000 7f395462d640 1 Processor -- start 2024-04-24T02:08:16.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.462+0000 7f395462d640 1 -- start start 2024-04-24T02:08:16.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.463+0000 7f395462d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f394c137ca0 0x7f394c13a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:16.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.463+0000 7f395462d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f394c09de70 con 0x7f394c09e750 2024-04-24T02:08:16.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.463+0000 7f395462d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f394c0a0690 con 0x7f394c137ca0 2024-04-24T02:08:16.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.463+0000 7f39523c9640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f394c09e750 0x7f394c0a0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39866/0 (socket says 172.21.15.57:39866) 2024-04-24T02:08:16.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.464+0000 7f39523c9640 1 -- 172.21.15.57:0/4128526890 learned_addr learned my addr 172.21.15.57:0/4128526890 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T02:08:16.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.464+0000 7f3951bc8640 1 --2- 172.21.15.57:0/4128526890 >> v2:172.21.15.57:3300/0 conn(0x7f394c137ca0 0x7f394c13a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:16.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.464+0000 7f39513c7640 1 -- 172.21.15.57:0/4128526890 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3978463345 0 0) 0x7f394c09de70 con 0x7f394c09e750 2024-04-24T02:08:16.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.464+0000 7f39513c7640 1 -- 172.21.15.57:0/4128526890 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3938003580 con 0x7f394c09e750 2024-04-24T02:08:16.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.464+0000 7f3951bc8640 1 -- 172.21.15.57:0/4128526890 >> v1:172.21.15.57:6789/0 conn(0x7f394c09e750 legacy=0x7f394c0a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:16.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.464+0000 7f3951bc8640 1 -- 172.21.15.57:0/4128526890 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f394c0a0380 con 0x7f394c137ca0 2024-04-24T02:08:16.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.464+0000 7f3951bc8640 1 --2- 172.21.15.57:0/4128526890 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f394c137ca0 0x7f394c13a0c0 crc :-1 s=READY pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac5782909937d07 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:16.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.464+0000 7f39513c7640 1 -- 172.21.15.57:0/4128526890 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f393c009d90 con 0x7f394c137ca0 2024-04-24T02:08:16.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.464+0000 7f39513c7640 1 -- 172.21.15.57:0/4128526890 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f393c00e230 con 0x7f394c137ca0 2024-04-24T02:08:16.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.464+0000 7f39513c7640 1 -- 172.21.15.57:0/4128526890 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f393c00e4d0 con 0x7f394c137ca0 2024-04-24T02:08:16.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.465+0000 7f395462d640 1 -- 172.21.15.57:0/4128526890 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f394c137ca0 msgr2=0x7f394c13a0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:16.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.465+0000 7f395462d640 1 --2- 172.21.15.57:0/4128526890 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f394c137ca0 0x7f394c13a0c0 crc :-1 s=READY pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:16.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.465+0000 7f395462d640 1 -- 172.21.15.57:0/4128526890 shutdown_connections 2024-04-24T02:08:16.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.465+0000 7f395462d640 1 --2- 172.21.15.57:0/4128526890 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f394c137ca0 0x7f394c13a0c0 unknown :-1 s=CLOSED pgs=12994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:16.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.465+0000 7f395462d640 1 -- 172.21.15.57:0/4128526890 >> 172.21.15.57:0/4128526890 conn(0x7f394c0a3d60 msgr2=0x7f394c0a4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:16.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.465+0000 7f395462d640 1 -- 172.21.15.57:0/4128526890 shutdown_connections 2024-04-24T02:08:16.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.465+0000 7f395462d640 1 -- 172.21.15.57:0/4128526890 wait complete. 2024-04-24T02:08:16.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.465+0000 7f395462d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:16.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.467+0000 7f395462d640 1 Processor -- start 2024-04-24T02:08:16.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.467+0000 7f395462d640 1 -- start start 2024-04-24T02:08:16.472 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.469+0000 7f395462d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f394c09e750 0x7f394c11f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:16.472 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.469+0000 7f395462d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f394c11ee50 con 0x7f394c09e750 2024-04-24T02:08:16.472 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.469+0000 7f39523c9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f394c09e750 0x7f394c11f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:16.472 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.469+0000 7f39523c9640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f394c09e750 0x7f394c11f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51838/0 (socket says 172.21.15.57:51838) 2024-04-24T02:08:16.472 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.469+0000 7f39523c9640 1 -- 172.21.15.57:0/3430927163 learned_addr learned my addr 172.21.15.57:0/3430927163 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:08:16.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.469+0000 7f39523c9640 1 -- 172.21.15.57:0/3430927163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f394c11f420 con 0x7f394c09e750 2024-04-24T02:08:16.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.469+0000 7f39523c9640 1 --2- 172.21.15.57:0/3430927163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f394c09e750 0x7f394c11f970 crc :-1 s=READY pgs=12995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:16.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.469+0000 7f3942ffd640 1 -- 172.21.15.57:0/3430927163 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3948005a60 con 0x7f394c09e750 2024-04-24T02:08:16.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.469+0000 7f3942ffd640 1 -- 172.21.15.57:0/3430927163 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f3948005bc0 con 0x7f394c09e750 2024-04-24T02:08:16.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.469+0000 7f395462d640 1 -- 172.21.15.57:0/3430927163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f394c120aa0 con 0x7f394c09e750 2024-04-24T02:08:16.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.469+0000 7f3942ffd640 1 -- 172.21.15.57:0/3430927163 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f3948005e60 con 0x7f394c09e750 2024-04-24T02:08:16.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.469+0000 7f395462d640 1 -- 172.21.15.57:0/3430927163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f394c11f080 con 0x7f394c09e750 2024-04-24T02:08:16.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.470+0000 7f395462d640 1 -- 172.21.15.57:0/3430927163 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f394c09f3c0 con 0x7f394c09e750 2024-04-24T02:08:16.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.470+0000 7f3942ffd640 1 -- 172.21.15.57:0/3430927163 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f39480070b0 con 0x7f394c09e750 2024-04-24T02:08:16.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.471+0000 7f3942ffd640 1 --2- 172.21.15.57:0/3430927163 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f3930038980 0x7f393003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:16.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.471+0000 7f3942ffd640 1 -- 172.21.15.57:0/3430927163 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(714..714 src has 395..714) ==== 3403+0+0 (crc 0 0 0) 0x7f3948048430 con 0x7f394c09e750 2024-04-24T02:08:16.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.471+0000 7f3942ffd640 1 --2- 172.21.15.57:0/3430927163 >> v2:172.21.15.84:6808/91137974 conn(0x7f393003ea40 0x7f3930040f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:16.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.471+0000 7f3942ffd640 1 -- 172.21.15.57:0/3430927163 --> v2:172.21.15.84:6808/91137974 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f39300415c0 con 0x7f393003ea40 2024-04-24T02:08:16.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.471+0000 7f3942ffd640 1 -- 172.21.15.57:0/3430927163 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=714) ==== 24+0+0 (crc 0 0 0) 0x7f394804a920 con 0x7f394c09e750 2024-04-24T02:08:16.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.471+0000 7f3951bc8640 1 --2- 172.21.15.57:0/3430927163 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f3930038980 0x7f393003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:16.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.472+0000 7f3951bc8640 1 --2- 172.21.15.57:0/3430927163 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f3930038980 0x7f393003ae90 crc :-1 s=READY pgs=3968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:16.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.472+0000 7f3952bca640 1 --2- 172.21.15.57:0/3430927163 >> v2:172.21.15.84:6808/91137974 conn(0x7f393003ea40 0x7f3930040f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-24T02:08:16.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.474+0000 7f3952bca640 1 --2- 172.21.15.57:0/3430927163 >> v2:172.21.15.84:6808/91137974 conn(0x7f393003ea40 0x7f3930040f30 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:16.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.476+0000 7f3942ffd640 1 -- 172.21.15.57:0/3430927163 <== osd.3 v2:172.21.15.84:6808/91137974 1 ==== command_reply(tid 1: 0 ) ==== 8+0+5172 (crc 0 0 0) 0x7f39300415c0 con 0x7f393003ea40 2024-04-24T02:08:16.480 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.479+0000 7f395462d640 1 -- 172.21.15.57:0/3430927163 --> v2:172.21.15.84:6808/91137974 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f394c069330 con 0x7f393003ea40 2024-04-24T02:08:16.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.481+0000 7f3942ffd640 1 -- 172.21.15.57:0/3430927163 <== osd.3 v2:172.21.15.84:6808/91137974 2 ==== command_reply(tid 2: 0 ) ==== 8+0+22 (crc 0 0 0) 0x7f394c069330 con 0x7f393003ea40 2024-04-24T02:08:16.482 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-04-24T02:08:16.482 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "" 2024-04-24T02:08:16.482 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-04-24T02:08:16.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.481+0000 7f395462d640 1 -- 172.21.15.57:0/3430927163 >> v2:172.21.15.84:6808/91137974 conn(0x7f393003ea40 msgr2=0x7f3930040f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:16.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.481+0000 7f395462d640 1 --2- 172.21.15.57:0/3430927163 >> v2:172.21.15.84:6808/91137974 conn(0x7f393003ea40 0x7f3930040f30 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:16.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.481+0000 7f395462d640 1 -- 172.21.15.57:0/3430927163 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f3930038980 msgr2=0x7f393003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:16.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.481+0000 7f395462d640 1 --2- 172.21.15.57:0/3430927163 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f3930038980 0x7f393003ae90 crc :-1 s=READY pgs=3968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:16.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.481+0000 7f395462d640 1 -- 172.21.15.57:0/3430927163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f394c09e750 msgr2=0x7f394c11f970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:16.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.481+0000 7f395462d640 1 --2- 172.21.15.57:0/3430927163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f394c09e750 0x7f394c11f970 crc :-1 s=READY pgs=12995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:16.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.481+0000 7f395462d640 1 -- 172.21.15.57:0/3430927163 shutdown_connections 2024-04-24T02:08:16.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.481+0000 7f395462d640 1 --2- 172.21.15.57:0/3430927163 >> v2:172.21.15.84:6808/91137974 conn(0x7f393003ea40 0x7f3930040f30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:16.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.481+0000 7f395462d640 1 --2- 172.21.15.57:0/3430927163 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f3930038980 0x7f393003ae90 unknown :-1 s=CLOSED pgs=3968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:16.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.481+0000 7f395462d640 1 --2- 172.21.15.57:0/3430927163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f394c09e750 0x7f394c11f970 unknown :-1 s=CLOSED pgs=12995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:16.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.481+0000 7f395462d640 1 -- 172.21.15.57:0/3430927163 >> 172.21.15.57:0/3430927163 conn(0x7f394c0a3d60 msgr2=0x7f394c0a5890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:16.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.481+0000 7f395462d640 1 -- 172.21.15.57:0/3430927163 shutdown_connections 2024-04-24T02:08:16.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.481+0000 7f395462d640 1 -- 172.21.15.57:0/3430927163 wait complete. 2024-04-24T02:08:16.493 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-24T02:08:16.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.598+0000 7f838eaad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:16.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.605+0000 7f838eaad640 1 Processor -- start 2024-04-24T02:08:16.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.605+0000 7f838eaad640 1 -- start start 2024-04-24T02:08:16.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.606+0000 7f838eaad640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8388137c50 0x7f838813a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:16.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.606+0000 7f838eaad640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83880a0000 con 0x7f838809e710 2024-04-24T02:08:16.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.606+0000 7f838eaad640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f838809e3c0 con 0x7f8388137c50 2024-04-24T02:08:16.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.607+0000 7f838c849640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f838809e710 0x7f83880a0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39882/0 (socket says 172.21.15.57:39882) 2024-04-24T02:08:16.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.607+0000 7f838c849640 1 -- 172.21.15.57:0/3575003550 learned_addr learned my addr 172.21.15.57:0/3575003550 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T02:08:16.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.607+0000 7f8387fff640 1 --2- 172.21.15.57:0/3575003550 >> v2:172.21.15.57:3300/0 conn(0x7f8388137c50 0x7f838813a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:16.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.607+0000 7f83877fe640 1 -- 172.21.15.57:0/3575003550 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3725809210 0 0) 0x7f83880a0000 con 0x7f838809e710 2024-04-24T02:08:16.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.607+0000 7f83877fe640 1 -- 172.21.15.57:0/3575003550 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8378003580 con 0x7f838809e710 2024-04-24T02:08:16.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.607+0000 7f8387fff640 1 -- 172.21.15.57:0/3575003550 >> v1:172.21.15.57:6789/0 conn(0x7f838809e710 legacy=0x7f83880a0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:16.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.607+0000 7f8387fff640 1 -- 172.21.15.57:0/3575003550 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83880a0730 con 0x7f8388137c50 2024-04-24T02:08:16.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.607+0000 7f8387fff640 1 --2- 172.21.15.57:0/3575003550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8388137c50 0x7f838813a070 crc :-1 s=READY pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae504ff97c4ecd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:16.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.607+0000 7f83877fe640 1 -- 172.21.15.57:0/3575003550 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8374009d80 con 0x7f8388137c50 2024-04-24T02:08:16.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.607+0000 7f83877fe640 1 -- 172.21.15.57:0/3575003550 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f837400e230 con 0x7f8388137c50 2024-04-24T02:08:16.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.607+0000 7f83877fe640 1 -- 172.21.15.57:0/3575003550 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f837400e4d0 con 0x7f8388137c50 2024-04-24T02:08:16.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.608+0000 7f838eaad640 1 -- 172.21.15.57:0/3575003550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8388137c50 msgr2=0x7f838813a070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:16.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.608+0000 7f838eaad640 1 --2- 172.21.15.57:0/3575003550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8388137c50 0x7f838813a070 crc :-1 s=READY pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:16.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.608+0000 7f838eaad640 1 -- 172.21.15.57:0/3575003550 shutdown_connections 2024-04-24T02:08:16.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.608+0000 7f838eaad640 1 --2- 172.21.15.57:0/3575003550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8388137c50 0x7f838813a070 unknown :-1 s=CLOSED pgs=12997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:16.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.608+0000 7f838eaad640 1 -- 172.21.15.57:0/3575003550 >> 172.21.15.57:0/3575003550 conn(0x7f83880a3af0 msgr2=0x7f83880a3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:16.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.608+0000 7f838eaad640 1 -- 172.21.15.57:0/3575003550 shutdown_connections 2024-04-24T02:08:16.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.608+0000 7f838eaad640 1 -- 172.21.15.57:0/3575003550 wait complete. 2024-04-24T02:08:16.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.608+0000 7f838eaad640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:16.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.610+0000 7f838eaad640 1 Processor -- start 2024-04-24T02:08:16.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.610+0000 7f838eaad640 1 -- start start 2024-04-24T02:08:16.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.612+0000 7f838eaad640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8388137c50 0x7f838811f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:16.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.612+0000 7f838eaad640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8388120800 con 0x7f8388137c50 2024-04-24T02:08:16.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.612+0000 7f838c849640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8388137c50 0x7f838811f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:16.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.612+0000 7f838c849640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8388137c50 0x7f838811f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51852/0 (socket says 172.21.15.57:51852) 2024-04-24T02:08:16.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.612+0000 7f838c849640 1 -- 172.21.15.57:0/432277730 learned_addr learned my addr 172.21.15.57:0/432277730 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:08:16.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.612+0000 7f838c849640 1 -- 172.21.15.57:0/432277730 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8388122c80 con 0x7f8388137c50 2024-04-24T02:08:16.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.612+0000 7f838c849640 1 --2- 172.21.15.57:0/432277730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8388137c50 0x7f838811f670 crc :-1 s=READY pgs=12998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:16.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.612+0000 7f83857fa640 1 -- 172.21.15.57:0/432277730 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f837c005a60 con 0x7f8388137c50 2024-04-24T02:08:16.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.612+0000 7f83857fa640 1 -- 172.21.15.57:0/432277730 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f837c005bc0 con 0x7f8388137c50 2024-04-24T02:08:16.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.612+0000 7f83857fa640 1 -- 172.21.15.57:0/432277730 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f837c005e60 con 0x7f8388137c50 2024-04-24T02:08:16.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.612+0000 7f838eaad640 1 -- 172.21.15.57:0/432277730 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f838811f110 con 0x7f8388137c50 2024-04-24T02:08:16.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.612+0000 7f838eaad640 1 -- 172.21.15.57:0/432277730 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8388122800 con 0x7f8388137c50 2024-04-24T02:08:16.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.613+0000 7f83857fa640 1 -- 172.21.15.57:0/432277730 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f837c0070b0 con 0x7f8388137c50 2024-04-24T02:08:16.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.613+0000 7f83857fa640 1 --2- 172.21.15.57:0/432277730 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f836c038980 0x7f836c03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:16.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.614+0000 7f83857fa640 1 -- 172.21.15.57:0/432277730 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(714..714 src has 395..714) ==== 3403+0+0 (crc 0 0 0) 0x7f837c048400 con 0x7f8388137c50 2024-04-24T02:08:16.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.614+0000 7f838eaad640 1 -- 172.21.15.57:0/432277730 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8388069330 con 0x7f8388137c50 2024-04-24T02:08:16.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.614+0000 7f8387fff640 1 --2- 172.21.15.57:0/432277730 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f836c038980 0x7f836c03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:16.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.614+0000 7f8387fff640 1 --2- 172.21.15.57:0/432277730 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f836c038980 0x7f836c03ae90 crc :-1 s=READY pgs=3969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:16.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.619+0000 7f83857fa640 1 -- 172.21.15.57:0/432277730 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f837c00da20 con 0x7f8388137c50 2024-04-24T02:08:16.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.807+0000 7f838eaad640 1 -- 172.21.15.57:0/432277730 --> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f83881216b0 con 0x7f836c038980 2024-04-24T02:08:16.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.808+0000 7f83857fa640 1 -- 172.21.15.57:0/432277730 <== mgr.4101 v2:172.21.15.84:6800/1747524692 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (crc 0 0 0) 0x7f8374009cd0 con 0x7f836c038980 2024-04-24T02:08:16.809 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 3 to deep-scrub 2024-04-24T02:08:16.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.810+0000 7f838eaad640 1 -- 172.21.15.57:0/432277730 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f836c038980 msgr2=0x7f836c03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:16.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.810+0000 7f838eaad640 1 --2- 172.21.15.57:0/432277730 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f836c038980 0x7f836c03ae90 crc :-1 s=READY pgs=3969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:16.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.810+0000 7f838eaad640 1 -- 172.21.15.57:0/432277730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8388137c50 msgr2=0x7f838811f670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:16.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.810+0000 7f838eaad640 1 --2- 172.21.15.57:0/432277730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8388137c50 0x7f838811f670 crc :-1 s=READY pgs=12998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:16.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.810+0000 7f838eaad640 1 -- 172.21.15.57:0/432277730 shutdown_connections 2024-04-24T02:08:16.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.810+0000 7f838eaad640 1 --2- 172.21.15.57:0/432277730 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f836c038980 0x7f836c03ae90 unknown :-1 s=CLOSED pgs=3969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:16.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.810+0000 7f838eaad640 1 --2- 172.21.15.57:0/432277730 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8388137c50 0x7f838811f670 unknown :-1 s=CLOSED pgs=12998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:16.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.810+0000 7f838eaad640 1 -- 172.21.15.57:0/432277730 >> 172.21.15.57:0/432277730 conn(0x7f83880a3af0 msgr2=0x7f83880a1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:16.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.810+0000 7f838eaad640 1 -- 172.21.15.57:0/432277730 shutdown_connections 2024-04-24T02:08:16.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.810+0000 7f838eaad640 1 -- 172.21.15.57:0/432277730 wait complete. 2024-04-24T02:08:16.823 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T02:08:16.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.929+0000 7fc910c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:16.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.934+0000 7fc910c6d640 1 Processor -- start 2024-04-24T02:08:16.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.934+0000 7fc910c6d640 1 -- start start 2024-04-24T02:08:16.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.936+0000 7fc910c6d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc90c1348f0 0x7fc90c136d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:16.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.936+0000 7fc910c6d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc90c06e750 con 0x7fc90c12e510 2024-04-24T02:08:16.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.936+0000 7fc910c6d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fc90c12f030 con 0x7fc90c1348f0 2024-04-24T02:08:16.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.936+0000 7fc90a59c640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc90c12e510 0x7fc90c12e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39884/0 (socket says 172.21.15.57:39884) 2024-04-24T02:08:16.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.936+0000 7fc90a59c640 1 -- 172.21.15.57:0/3213682845 learned_addr learned my addr 172.21.15.57:0/3213682845 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T02:08:16.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.936+0000 7fc909d9b640 1 --2- 172.21.15.57:0/3213682845 >> v2:172.21.15.57:3300/0 conn(0x7fc90c1348f0 0x7fc90c136d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:16.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.936+0000 7fc90959a640 1 -- 172.21.15.57:0/3213682845 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3872803406 0 0) 0x7fc90c06e750 con 0x7fc90c12e510 2024-04-24T02:08:16.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.937+0000 7fc90959a640 1 -- 172.21.15.57:0/3213682845 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8f8003580 con 0x7fc90c12e510 2024-04-24T02:08:16.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.937+0000 7fc909d9b640 1 -- 172.21.15.57:0/3213682845 >> v1:172.21.15.57:6789/0 conn(0x7fc90c12e510 legacy=0x7fc90c12e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:16.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.937+0000 7fc909d9b640 1 -- 172.21.15.57:0/3213682845 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc90c073a80 con 0x7fc90c1348f0 2024-04-24T02:08:16.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.937+0000 7fc909d9b640 1 --2- 172.21.15.57:0/3213682845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc90c1348f0 0x7fc90c136d10 crc :-1 s=READY pgs=13000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5130f75386eb175 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:16.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.937+0000 7fc90959a640 1 -- 172.21.15.57:0/3213682845 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc8f4009d90 con 0x7fc90c1348f0 2024-04-24T02:08:16.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.937+0000 7fc90959a640 1 -- 172.21.15.57:0/3213682845 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc8f400e230 con 0x7fc90c1348f0 2024-04-24T02:08:16.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.937+0000 7fc90959a640 1 -- 172.21.15.57:0/3213682845 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc8f400e4d0 con 0x7fc90c1348f0 2024-04-24T02:08:16.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.938+0000 7fc910c6d640 1 -- 172.21.15.57:0/3213682845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc90c1348f0 msgr2=0x7fc90c136d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:16.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.938+0000 7fc910c6d640 1 --2- 172.21.15.57:0/3213682845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc90c1348f0 0x7fc90c136d10 crc :-1 s=READY pgs=13000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:16.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.938+0000 7fc910c6d640 1 -- 172.21.15.57:0/3213682845 shutdown_connections 2024-04-24T02:08:16.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.938+0000 7fc910c6d640 1 --2- 172.21.15.57:0/3213682845 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc90c1348f0 0x7fc90c136d10 unknown :-1 s=CLOSED pgs=13000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:16.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.938+0000 7fc910c6d640 1 -- 172.21.15.57:0/3213682845 >> 172.21.15.57:0/3213682845 conn(0x7fc90c0a0920 msgr2=0x7fc90c0a0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:16.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.938+0000 7fc910c6d640 1 -- 172.21.15.57:0/3213682845 shutdown_connections 2024-04-24T02:08:16.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.938+0000 7fc910c6d640 1 -- 172.21.15.57:0/3213682845 wait complete. 2024-04-24T02:08:16.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.938+0000 7fc910c6d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:16.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.940+0000 7fc910c6d640 1 Processor -- start 2024-04-24T02:08:16.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.940+0000 7fc910c6d640 1 -- start start 2024-04-24T02:08:16.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.941+0000 7fc910c6d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc90c12e510 0x7fc90c11bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:16.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.942+0000 7fc910c6d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc90c11f380 con 0x7fc90c12e510 2024-04-24T02:08:16.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.942+0000 7fc90a59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc90c12e510 0x7fc90c11bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:16.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.942+0000 7fc90a59c640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc90c12e510 0x7fc90c11bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:51864/0 (socket says 172.21.15.57:51864) 2024-04-24T02:08:16.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.942+0000 7fc90a59c640 1 -- 172.21.15.57:0/2662103997 learned_addr learned my addr 172.21.15.57:0/2662103997 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:08:16.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.942+0000 7fc90a59c640 1 -- 172.21.15.57:0/2662103997 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc90c11cfd0 con 0x7fc90c12e510 2024-04-24T02:08:16.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.942+0000 7fc90a59c640 1 --2- 172.21.15.57:0/2662103997 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc90c12e510 0x7fc90c11bcd0 crc :-1 s=READY pgs=13001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:16.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.942+0000 7fc902ffd640 1 -- 172.21.15.57:0/2662103997 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc8fc0070b0 con 0x7fc90c12e510 2024-04-24T02:08:16.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.942+0000 7fc902ffd640 1 -- 172.21.15.57:0/2662103997 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7fc8fc007210 con 0x7fc90c12e510 2024-04-24T02:08:16.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.942+0000 7fc910c6d640 1 -- 172.21.15.57:0/2662103997 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc90c074f70 con 0x7fc90c12e510 2024-04-24T02:08:16.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.942+0000 7fc902ffd640 1 -- 172.21.15.57:0/2662103997 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7fc8fc0074b0 con 0x7fc90c12e510 2024-04-24T02:08:16.945 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.942+0000 7fc910c6d640 1 -- 172.21.15.57:0/2662103997 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc90c11d8a0 con 0x7fc90c12e510 2024-04-24T02:08:16.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.943+0000 7fc902ffd640 1 -- 172.21.15.57:0/2662103997 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7fc8fc0076a0 con 0x7fc90c12e510 2024-04-24T02:08:16.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.943+0000 7fc910c6d640 1 -- 172.21.15.57:0/2662103997 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc90c063900 con 0x7fc90c12e510 2024-04-24T02:08:16.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.943+0000 7fc902ffd640 1 --2- 172.21.15.57:0/2662103997 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fc8ec038980 0x7fc8ec03ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:16.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.943+0000 7fc902ffd640 1 -- 172.21.15.57:0/2662103997 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(714..714 src has 395..714) ==== 3403+0+0 (crc 0 0 0) 0x7fc8fc048bf0 con 0x7fc90c12e510 2024-04-24T02:08:16.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.944+0000 7fc909d9b640 1 --2- 172.21.15.57:0/2662103997 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fc8ec038980 0x7fc8ec03ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:16.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.944+0000 7fc909d9b640 1 --2- 172.21.15.57:0/2662103997 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fc8ec038980 0x7fc8ec03ae90 crc :-1 s=READY pgs=3970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:16.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:16.949+0000 7fc902ffd640 1 -- 172.21.15.57:0/2662103997 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7fc8fc0092e0 con 0x7fc90c12e510 2024-04-24T02:08:17.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:17.129+0000 7fc910c6d640 1 -- 172.21.15.57:0/2662103997 --> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc90c074f70 con 0x7fc8ec038980 2024-04-24T02:08:17.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:17.133+0000 7fc902ffd640 1 -- 172.21.15.57:0/2662103997 <== mgr.4101 v2:172.21.15.84:6800/1747524692 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109148 (crc 0 0 0) 0x7fc90c074f70 con 0x7fc8ec038980 2024-04-24T02:08:17.135 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T02:08:17.136 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-24T02:08:17.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:17.135+0000 7fc910c6d640 1 -- 172.21.15.57:0/2662103997 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fc8ec038980 msgr2=0x7fc8ec03ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:17.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:17.135+0000 7fc910c6d640 1 --2- 172.21.15.57:0/2662103997 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fc8ec038980 0x7fc8ec03ae90 crc :-1 s=READY pgs=3970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:17.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:17.135+0000 7fc910c6d640 1 -- 172.21.15.57:0/2662103997 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc90c12e510 msgr2=0x7fc90c11bcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:17.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:17.135+0000 7fc910c6d640 1 --2- 172.21.15.57:0/2662103997 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc90c12e510 0x7fc90c11bcd0 crc :-1 s=READY pgs=13001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:17.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:17.135+0000 7fc910c6d640 1 -- 172.21.15.57:0/2662103997 shutdown_connections 2024-04-24T02:08:17.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:17.135+0000 7fc910c6d640 1 --2- 172.21.15.57:0/2662103997 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7fc8ec038980 0x7fc8ec03ae90 unknown :-1 s=CLOSED pgs=3970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:17.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:17.135+0000 7fc910c6d640 1 --2- 172.21.15.57:0/2662103997 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc90c12e510 0x7fc90c11bcd0 unknown :-1 s=CLOSED pgs=13001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:17.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:17.135+0000 7fc910c6d640 1 -- 172.21.15.57:0/2662103997 >> 172.21.15.57:0/2662103997 conn(0x7fc90c0a0920 msgr2=0x7fc90c09ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:17.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:17.135+0000 7fc910c6d640 1 -- 172.21.15.57:0/2662103997 shutdown_connections 2024-04-24T02:08:17.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:17.135+0000 7fc910c6d640 1 -- 172.21.15.57:0/2662103997 wait complete. 2024-04-24T02:08:17.148 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":1297,"stamp":"2024-04-24T02:08:15.196896+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590373,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":97,"num_write":144,"num_write_kb":1901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":296624,"kb_used_data":15312,"kb_used_omap":0,"kb_used_meta":281280,"kb_avail":419133776,"statfs":{"total":429496729600,"available":429192986624,"internally_reserved":0,"allocated":15679488,"data_stored":6876411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":288030720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-296900,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-25,"num_write_kb":-300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001981"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1273,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:11.996912+0000","last_change":"2024-04-24T01:54:29.908821+0000","last_active":"2024-04-24T02:08:11.996912+0000","last_peered":"2024-04-24T02:08:11.996912+0000","last_clean":"2024-04-24T02:08:11.996912+0000","last_became_active":"2024-04-24T01:54:29.899903+0000","last_became_peered":"2024-04-24T01:54:29.899903+0000","last_unstale":"2024-04-24T02:08:11.996912+0000","last_undegraded":"2024-04-24T02:08:11.996912+0000","last_fullsized":"2024-04-24T02:08:11.996912+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1275,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.509146+0000","last_change":"2024-04-24T01:54:29.967629+0000","last_active":"2024-04-24T02:08:14.509146+0000","last_peered":"2024-04-24T02:08:14.509146+0000","last_clean":"2024-04-24T02:08:14.509146+0000","last_became_active":"2024-04-24T01:54:29.955445+0000","last_became_peered":"2024-04-24T01:54:29.955445+0000","last_unstale":"2024-04-24T02:08:14.509146+0000","last_undegraded":"2024-04-24T02:08:14.509146+0000","last_fullsized":"2024-04-24T02:08:14.509146+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1277,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.260559+0000","last_change":"2024-04-24T01:54:29.885625+0000","last_active":"2024-04-24T02:08:14.260559+0000","last_peered":"2024-04-24T02:08:14.260559+0000","last_clean":"2024-04-24T02:08:14.260559+0000","last_became_active":"2024-04-24T01:54:29.877273+0000","last_became_peered":"2024-04-24T01:54:29.877273+0000","last_unstale":"2024-04-24T02:08:14.260559+0000","last_undegraded":"2024-04-24T02:08:14.260559+0000","last_fullsized":"2024-04-24T02:08:14.260559+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1241,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.448270+0000","last_change":"2024-04-24T01:54:29.885696+0000","last_active":"2024-04-24T02:08:14.448270+0000","last_peered":"2024-04-24T02:08:14.448270+0000","last_clean":"2024-04-24T02:08:14.448270+0000","last_became_active":"2024-04-24T01:54:29.878778+0000","last_became_peered":"2024-04-24T01:54:29.878778+0000","last_unstale":"2024-04-24T02:08:14.448270+0000","last_undegraded":"2024-04-24T02:08:14.448270+0000","last_fullsized":"2024-04-24T02:08:14.448270+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1273,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:11.966769+0000","last_change":"2024-04-24T01:54:29.953603+0000","last_active":"2024-04-24T02:08:11.966769+0000","last_peered":"2024-04-24T02:08:11.966769+0000","last_clean":"2024-04-24T02:08:11.966769+0000","last_became_active":"2024-04-24T01:54:29.938885+0000","last_became_peered":"2024-04-24T01:54:29.938885+0000","last_unstale":"2024-04-24T02:08:11.966769+0000","last_undegraded":"2024-04-24T02:08:11.966769+0000","last_fullsized":"2024-04-24T02:08:11.966769+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1275,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.544899+0000","last_change":"2024-04-24T01:54:29.937576+0000","last_active":"2024-04-24T02:08:14.544899+0000","last_peered":"2024-04-24T02:08:14.544899+0000","last_clean":"2024-04-24T02:08:14.544899+0000","last_became_active":"2024-04-24T01:54:29.925475+0000","last_became_peered":"2024-04-24T01:54:29.925475+0000","last_unstale":"2024-04-24T02:08:14.544899+0000","last_undegraded":"2024-04-24T02:08:14.544899+0000","last_fullsized":"2024-04-24T02:08:14.544899+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1275,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.537922+0000","last_change":"2024-04-24T01:54:30.009375+0000","last_active":"2024-04-24T02:08:14.537922+0000","last_peered":"2024-04-24T02:08:14.537922+0000","last_clean":"2024-04-24T02:08:14.537922+0000","last_became_active":"2024-04-24T01:54:30.002762+0000","last_became_peered":"2024-04-24T01:54:30.002762+0000","last_unstale":"2024-04-24T02:08:14.537922+0000","last_undegraded":"2024-04-24T02:08:14.537922+0000","last_fullsized":"2024-04-24T02:08:14.537922+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1275,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.501088+0000","last_change":"2024-04-24T01:54:29.958936+0000","last_active":"2024-04-24T02:08:14.501088+0000","last_peered":"2024-04-24T02:08:14.501088+0000","last_clean":"2024-04-24T02:08:14.501088+0000","last_became_active":"2024-04-24T01:54:29.940930+0000","last_became_peered":"2024-04-24T01:54:29.940930+0000","last_unstale":"2024-04-24T02:08:14.501088+0000","last_undegraded":"2024-04-24T02:08:14.501088+0000","last_fullsized":"2024-04-24T02:08:14.501088+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1241,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.517289+0000","last_change":"2024-04-24T01:54:29.927605+0000","last_active":"2024-04-24T02:08:14.517289+0000","last_peered":"2024-04-24T02:08:14.517289+0000","last_clean":"2024-04-24T02:08:14.517289+0000","last_became_active":"2024-04-24T01:54:29.915996+0000","last_became_peered":"2024-04-24T01:54:29.915996+0000","last_unstale":"2024-04-24T02:08:14.517289+0000","last_undegraded":"2024-04-24T02:08:14.517289+0000","last_fullsized":"2024-04-24T02:08:14.517289+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1277,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.271923+0000","last_change":"2024-04-24T01:54:29.937993+0000","last_active":"2024-04-24T02:08:14.271923+0000","last_peered":"2024-04-24T02:08:14.271923+0000","last_clean":"2024-04-24T02:08:14.271923+0000","last_became_active":"2024-04-24T01:54:29.932001+0000","last_became_peered":"2024-04-24T01:54:29.932001+0000","last_unstale":"2024-04-24T02:08:14.271923+0000","last_undegraded":"2024-04-24T02:08:14.271923+0000","last_fullsized":"2024-04-24T02:08:14.271923+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1241,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.490914+0000","last_change":"2024-04-24T01:54:29.983449+0000","last_active":"2024-04-24T02:08:14.490914+0000","last_peered":"2024-04-24T02:08:14.490914+0000","last_clean":"2024-04-24T02:08:14.490914+0000","last_became_active":"2024-04-24T01:54:29.977785+0000","last_became_peered":"2024-04-24T01:54:29.977785+0000","last_unstale":"2024-04-24T02:08:14.490914+0000","last_undegraded":"2024-04-24T02:08:14.490914+0000","last_fullsized":"2024-04-24T02:08:14.490914+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1275,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.474978+0000","last_change":"2024-04-24T01:54:29.984917+0000","last_active":"2024-04-24T02:08:14.474978+0000","last_peered":"2024-04-24T02:08:14.474978+0000","last_clean":"2024-04-24T02:08:14.474978+0000","last_became_active":"2024-04-24T01:54:29.974222+0000","last_became_peered":"2024-04-24T01:54:29.974222+0000","last_unstale":"2024-04-24T02:08:14.474978+0000","last_undegraded":"2024-04-24T02:08:14.474978+0000","last_fullsized":"2024-04-24T02:08:14.474978+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1241,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.430118+0000","last_change":"2024-04-24T01:54:30.012455+0000","last_active":"2024-04-24T02:08:14.430118+0000","last_peered":"2024-04-24T02:08:14.430118+0000","last_clean":"2024-04-24T02:08:14.430118+0000","last_became_active":"2024-04-24T01:54:30.006792+0000","last_became_peered":"2024-04-24T01:54:30.006792+0000","last_unstale":"2024-04-24T02:08:14.430118+0000","last_undegraded":"2024-04-24T02:08:14.430118+0000","last_fullsized":"2024-04-24T02:08:14.430118+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1241,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.475435+0000","last_change":"2024-04-24T01:54:29.931288+0000","last_active":"2024-04-24T02:08:14.475435+0000","last_peered":"2024-04-24T02:08:14.475435+0000","last_clean":"2024-04-24T02:08:14.475435+0000","last_became_active":"2024-04-24T01:54:29.921241+0000","last_became_peered":"2024-04-24T01:54:29.921241+0000","last_unstale":"2024-04-24T02:08:14.475435+0000","last_undegraded":"2024-04-24T02:08:14.475435+0000","last_fullsized":"2024-04-24T02:08:14.475435+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1275,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.503056+0000","last_change":"2024-04-24T01:54:29.944487+0000","last_active":"2024-04-24T02:08:14.503056+0000","last_peered":"2024-04-24T02:08:14.503056+0000","last_clean":"2024-04-24T02:08:14.503056+0000","last_became_active":"2024-04-24T01:54:29.929555+0000","last_became_peered":"2024-04-24T01:54:29.929555+0000","last_unstale":"2024-04-24T02:08:14.503056+0000","last_undegraded":"2024-04-24T02:08:14.503056+0000","last_fullsized":"2024-04-24T02:08:14.503056+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1275,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.533662+0000","last_change":"2024-04-24T01:54:29.970476+0000","last_active":"2024-04-24T02:08:14.533662+0000","last_peered":"2024-04-24T02:08:14.533662+0000","last_clean":"2024-04-24T02:08:14.533662+0000","last_became_active":"2024-04-24T01:54:29.949994+0000","last_became_peered":"2024-04-24T01:54:29.949994+0000","last_unstale":"2024-04-24T02:08:14.533662+0000","last_undegraded":"2024-04-24T02:08:14.533662+0000","last_fullsized":"2024-04-24T02:08:14.533662+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1275,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.535608+0000","last_change":"2024-04-24T01:54:29.978873+0000","last_active":"2024-04-24T02:08:14.535608+0000","last_peered":"2024-04-24T02:08:14.535608+0000","last_clean":"2024-04-24T02:08:14.535608+0000","last_became_active":"2024-04-24T01:54:29.962939+0000","last_became_peered":"2024-04-24T01:54:29.962939+0000","last_unstale":"2024-04-24T02:08:14.535608+0000","last_undegraded":"2024-04-24T02:08:14.535608+0000","last_fullsized":"2024-04-24T02:08:14.535608+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1241,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.522219+0000","last_change":"2024-04-24T01:54:29.967298+0000","last_active":"2024-04-24T02:08:14.522219+0000","last_peered":"2024-04-24T02:08:14.522219+0000","last_clean":"2024-04-24T02:08:14.522219+0000","last_became_active":"2024-04-24T01:54:29.960381+0000","last_became_peered":"2024-04-24T01:54:29.960381+0000","last_unstale":"2024-04-24T02:08:14.522219+0000","last_undegraded":"2024-04-24T02:08:14.522219+0000","last_fullsized":"2024-04-24T02:08:14.522219+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1277,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.241862+0000","last_change":"2024-04-24T01:54:29.883604+0000","last_active":"2024-04-24T02:08:14.241862+0000","last_peered":"2024-04-24T02:08:14.241862+0000","last_clean":"2024-04-24T02:08:14.241862+0000","last_became_active":"2024-04-24T01:54:29.874172+0000","last_became_peered":"2024-04-24T01:54:29.874172+0000","last_unstale":"2024-04-24T02:08:14.241862+0000","last_undegraded":"2024-04-24T02:08:14.241862+0000","last_fullsized":"2024-04-24T02:08:14.241862+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1273,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:11.942184+0000","last_change":"2024-04-24T01:54:29.959775+0000","last_active":"2024-04-24T02:08:11.942184+0000","last_peered":"2024-04-24T02:08:11.942184+0000","last_clean":"2024-04-24T02:08:11.942184+0000","last_became_active":"2024-04-24T01:54:29.950635+0000","last_became_peered":"2024-04-24T01:54:29.950635+0000","last_unstale":"2024-04-24T02:08:11.942184+0000","last_undegraded":"2024-04-24T02:08:11.942184+0000","last_fullsized":"2024-04-24T02:08:11.942184+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1273,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:12.029983+0000","last_change":"2024-04-24T01:54:29.988510+0000","last_active":"2024-04-24T02:08:12.029983+0000","last_peered":"2024-04-24T02:08:12.029983+0000","last_clean":"2024-04-24T02:08:12.029983+0000","last_became_active":"2024-04-24T01:54:29.981633+0000","last_became_peered":"2024-04-24T01:54:29.981633+0000","last_unstale":"2024-04-24T02:08:12.029983+0000","last_undegraded":"2024-04-24T02:08:12.029983+0000","last_fullsized":"2024-04-24T02:08:12.029983+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1273,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:12.023093+0000","last_change":"2024-04-24T01:54:29.973040+0000","last_active":"2024-04-24T02:08:12.023093+0000","last_peered":"2024-04-24T02:08:12.023093+0000","last_clean":"2024-04-24T02:08:12.023093+0000","last_became_active":"2024-04-24T01:54:29.963206+0000","last_became_peered":"2024-04-24T01:54:29.963206+0000","last_unstale":"2024-04-24T02:08:12.023093+0000","last_undegraded":"2024-04-24T02:08:12.023093+0000","last_fullsized":"2024-04-24T02:08:12.023093+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1277,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.263158+0000","last_change":"2024-04-24T01:54:29.916876+0000","last_active":"2024-04-24T02:08:14.263158+0000","last_peered":"2024-04-24T02:08:14.263158+0000","last_clean":"2024-04-24T02:08:14.263158+0000","last_became_active":"2024-04-24T01:54:29.899615+0000","last_became_peered":"2024-04-24T01:54:29.899615+0000","last_unstale":"2024-04-24T02:08:14.263158+0000","last_undegraded":"2024-04-24T02:08:14.263158+0000","last_fullsized":"2024-04-24T02:08:14.263158+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1241,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.500473+0000","last_change":"2024-04-24T01:54:29.942521+0000","last_active":"2024-04-24T02:08:14.500473+0000","last_peered":"2024-04-24T02:08:14.500473+0000","last_clean":"2024-04-24T02:08:14.500473+0000","last_became_active":"2024-04-24T01:54:29.933820+0000","last_became_peered":"2024-04-24T01:54:29.933820+0000","last_unstale":"2024-04-24T02:08:14.500473+0000","last_undegraded":"2024-04-24T02:08:14.500473+0000","last_fullsized":"2024-04-24T02:08:14.500473+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1241,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.504344+0000","last_change":"2024-04-24T01:54:29.903130+0000","last_active":"2024-04-24T02:08:14.504344+0000","last_peered":"2024-04-24T02:08:14.504344+0000","last_clean":"2024-04-24T02:08:14.504344+0000","last_became_active":"2024-04-24T01:54:29.897105+0000","last_became_peered":"2024-04-24T01:54:29.897105+0000","last_unstale":"2024-04-24T02:08:14.504344+0000","last_undegraded":"2024-04-24T02:08:14.504344+0000","last_fullsized":"2024-04-24T02:08:14.504344+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1275,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.432979+0000","last_change":"2024-04-24T01:54:29.935141+0000","last_active":"2024-04-24T02:08:14.432979+0000","last_peered":"2024-04-24T02:08:14.432979+0000","last_clean":"2024-04-24T02:08:14.432979+0000","last_became_active":"2024-04-24T01:54:29.920622+0000","last_became_peered":"2024-04-24T01:54:29.920622+0000","last_unstale":"2024-04-24T02:08:14.432979+0000","last_undegraded":"2024-04-24T02:08:14.432979+0000","last_fullsized":"2024-04-24T02:08:14.432979+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1241,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.498049+0000","last_change":"2024-04-24T01:54:29.954567+0000","last_active":"2024-04-24T02:08:14.498049+0000","last_peered":"2024-04-24T02:08:14.498049+0000","last_clean":"2024-04-24T02:08:14.498049+0000","last_became_active":"2024-04-24T01:54:29.946732+0000","last_became_peered":"2024-04-24T01:54:29.946732+0000","last_unstale":"2024-04-24T02:08:14.498049+0000","last_undegraded":"2024-04-24T02:08:14.498049+0000","last_fullsized":"2024-04-24T02:08:14.498049+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1275,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.505872+0000","last_change":"2024-04-24T01:54:30.051664+0000","last_active":"2024-04-24T02:08:14.505872+0000","last_peered":"2024-04-24T02:08:14.505872+0000","last_clean":"2024-04-24T02:08:14.505872+0000","last_became_active":"2024-04-24T01:54:30.037754+0000","last_became_peered":"2024-04-24T01:54:30.037754+0000","last_unstale":"2024-04-24T02:08:14.505872+0000","last_undegraded":"2024-04-24T02:08:14.505872+0000","last_fullsized":"2024-04-24T02:08:14.505872+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1275,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.540339+0000","last_change":"2024-04-24T01:54:29.911375+0000","last_active":"2024-04-24T02:08:14.540339+0000","last_peered":"2024-04-24T02:08:14.540339+0000","last_clean":"2024-04-24T02:08:14.540339+0000","last_became_active":"2024-04-24T01:54:29.904467+0000","last_became_peered":"2024-04-24T01:54:29.904467+0000","last_unstale":"2024-04-24T02:08:14.540339+0000","last_undegraded":"2024-04-24T02:08:14.540339+0000","last_fullsized":"2024-04-24T02:08:14.540339+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1275,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.471604+0000","last_change":"2024-04-24T01:54:30.026621+0000","last_active":"2024-04-24T02:08:14.471604+0000","last_peered":"2024-04-24T02:08:14.471604+0000","last_clean":"2024-04-24T02:08:14.471604+0000","last_became_active":"2024-04-24T01:54:30.019236+0000","last_became_peered":"2024-04-24T01:54:30.019236+0000","last_unstale":"2024-04-24T02:08:14.471604+0000","last_undegraded":"2024-04-24T02:08:14.471604+0000","last_fullsized":"2024-04-24T02:08:14.471604+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1286,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:11.994270+0000","last_change":"2024-04-24T01:54:29.879709+0000","last_active":"2024-04-24T02:08:11.994270+0000","last_peered":"2024-04-24T02:08:11.994270+0000","last_clean":"2024-04-24T02:08:11.994270+0000","last_became_active":"2024-04-24T01:54:29.873358+0000","last_became_peered":"2024-04-24T01:54:29.873358+0000","last_unstale":"2024-04-24T02:08:11.994270+0000","last_undegraded":"2024-04-24T02:08:11.994270+0000","last_fullsized":"2024-04-24T02:08:11.994270+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1277,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.277961+0000","last_change":"2024-04-24T01:54:29.921138+0000","last_active":"2024-04-24T02:08:14.277961+0000","last_peered":"2024-04-24T02:08:14.277961+0000","last_clean":"2024-04-24T02:08:14.277961+0000","last_became_active":"2024-04-24T01:54:29.909001+0000","last_became_peered":"2024-04-24T01:54:29.909001+0000","last_unstale":"2024-04-24T02:08:14.277961+0000","last_undegraded":"2024-04-24T02:08:14.277961+0000","last_fullsized":"2024-04-24T02:08:14.277961+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:54:28.682492+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1863,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:12.129871+0000","last_change":"2024-04-24T01:48:40.062414+0000","last_active":"2024-04-24T02:08:12.129871+0000","last_peered":"2024-04-24T02:08:12.129871+0000","last_clean":"2024-04-24T02:08:12.129871+0000","last_became_active":"2024-04-24T01:48:40.055629+0000","last_became_peered":"2024-04-24T01:48:40.055629+0000","last_unstale":"2024-04-24T02:08:12.129871+0000","last_undegraded":"2024-04-24T02:08:12.129871+0000","last_fullsized":"2024-04-24T02:08:12.129871+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1867,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.385783+0000","last_change":"2024-04-24T01:48:40.045311+0000","last_active":"2024-04-24T02:08:14.385783+0000","last_peered":"2024-04-24T02:08:14.385783+0000","last_clean":"2024-04-24T02:08:14.385783+0000","last_became_active":"2024-04-24T01:48:40.041551+0000","last_became_peered":"2024-04-24T01:48:40.041551+0000","last_unstale":"2024-04-24T02:08:14.385783+0000","last_undegraded":"2024-04-24T02:08:14.385783+0000","last_fullsized":"2024-04-24T02:08:14.385783+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1847,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.646489+0000","last_change":"2024-04-24T01:48:40.045108+0000","last_active":"2024-04-24T02:08:14.646489+0000","last_peered":"2024-04-24T02:08:14.646489+0000","last_clean":"2024-04-24T02:08:14.646489+0000","last_became_active":"2024-04-24T01:48:40.038574+0000","last_became_peered":"2024-04-24T01:48:40.038574+0000","last_unstale":"2024-04-24T02:08:14.646489+0000","last_undegraded":"2024-04-24T02:08:14.646489+0000","last_fullsized":"2024-04-24T02:08:14.646489+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1867,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.261343+0000","last_change":"2024-04-24T01:48:40.035237+0000","last_active":"2024-04-24T02:08:14.261343+0000","last_peered":"2024-04-24T02:08:14.261343+0000","last_clean":"2024-04-24T02:08:14.261343+0000","last_became_active":"2024-04-24T01:48:40.030062+0000","last_became_peered":"2024-04-24T01:48:40.030062+0000","last_unstale":"2024-04-24T02:08:14.261343+0000","last_undegraded":"2024-04-24T02:08:14.261343+0000","last_fullsized":"2024-04-24T02:08:14.261343+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1873,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.559780+0000","last_change":"2024-04-24T01:48:40.046631+0000","last_active":"2024-04-24T02:08:14.559780+0000","last_peered":"2024-04-24T02:08:14.559780+0000","last_clean":"2024-04-24T02:08:14.559780+0000","last_became_active":"2024-04-24T01:48:40.040843+0000","last_became_peered":"2024-04-24T01:48:40.040843+0000","last_unstale":"2024-04-24T02:08:14.559780+0000","last_undegraded":"2024-04-24T02:08:14.559780+0000","last_fullsized":"2024-04-24T02:08:14.559780+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1863,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:12.037569+0000","last_change":"2024-04-24T01:48:40.043159+0000","last_active":"2024-04-24T02:08:12.037569+0000","last_peered":"2024-04-24T02:08:12.037569+0000","last_clean":"2024-04-24T02:08:12.037569+0000","last_became_active":"2024-04-24T01:48:40.033297+0000","last_became_peered":"2024-04-24T01:48:40.033297+0000","last_unstale":"2024-04-24T02:08:12.037569+0000","last_undegraded":"2024-04-24T02:08:12.037569+0000","last_fullsized":"2024-04-24T02:08:12.037569+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1873,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.628603+0000","last_change":"2024-04-24T01:48:40.063620+0000","last_active":"2024-04-24T02:08:14.628603+0000","last_peered":"2024-04-24T02:08:14.628603+0000","last_clean":"2024-04-24T02:08:14.628603+0000","last_became_active":"2024-04-24T01:48:40.054792+0000","last_became_peered":"2024-04-24T01:48:40.054792+0000","last_unstale":"2024-04-24T02:08:14.628603+0000","last_undegraded":"2024-04-24T02:08:14.628603+0000","last_fullsized":"2024-04-24T02:08:14.628603+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1863,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:12.156482+0000","last_change":"2024-04-24T01:48:40.057853+0000","last_active":"2024-04-24T02:08:12.156482+0000","last_peered":"2024-04-24T02:08:12.156482+0000","last_clean":"2024-04-24T02:08:12.156482+0000","last_became_active":"2024-04-24T01:48:40.052084+0000","last_became_peered":"2024-04-24T01:48:40.052084+0000","last_unstale":"2024-04-24T02:08:12.156482+0000","last_undegraded":"2024-04-24T02:08:12.156482+0000","last_fullsized":"2024-04-24T02:08:12.156482+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:38.975626+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":1980,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:14.520763+0000","last_change":"2024-04-24T01:48:38.013745+0000","last_active":"2024-04-24T02:08:14.520763+0000","last_peered":"2024-04-24T02:08:14.520763+0000","last_clean":"2024-04-24T02:08:14.520763+0000","last_became_active":"2024-04-24T01:48:38.008438+0000","last_became_peered":"2024-04-24T01:48:38.008438+0000","last_unstale":"2024-04-24T02:08:14.520763+0000","last_undegraded":"2024-04-24T02:08:14.520763+0000","last_fullsized":"2024-04-24T02:08:14.520763+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T01:48:36.956380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T01:48:36.956380+0000","last_clean_scrub_stamp":"2024-04-24T01:48:36.956380+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706842,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":67152,"kb_used_data":4104,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":104790448,"statfs":{"total":107374182400,"available":107305418752,"internally_reserved":0,"allocated":4202496,"data_stored":2051882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706842,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":79072,"kb_used_data":3544,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104778528,"statfs":{"total":107374182400,"available":107293212672,"internally_reserved":0,"allocated":3629056,"data_stored":1392266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706842,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":78960,"kb_used_data":3432,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104778640,"statfs":{"total":107374182400,"available":107293327360,"internally_reserved":0,"allocated":3514368,"data_stored":1342652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706842,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":71440,"kb_used_data":4232,"kb_used_omap":0,"kb_used_meta":67200,"kb_avail":104786160,"statfs":{"total":107374182400,"available":107301027840,"internally_reserved":0,"allocated":4333568,"data_stored":2089611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68812800},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T02:08:17.152 INFO:tasks.ceph:pgid 75.1f last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.152 INFO:tasks.ceph:pgid 75.1e last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.152 INFO:tasks.ceph:pgid 75.1d last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.153 INFO:tasks.ceph:pgid 75.1c last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.153 INFO:tasks.ceph:pgid 75.1b last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.153 INFO:tasks.ceph:pgid 75.1a last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.153 INFO:tasks.ceph:pgid 75.19 last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.153 INFO:tasks.ceph:pgid 75.18 last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.153 INFO:tasks.ceph:pgid 75.17 last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.153 INFO:tasks.ceph:pgid 75.16 last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.153 INFO:tasks.ceph:pgid 75.15 last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.153 INFO:tasks.ceph:pgid 75.14 last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.153 INFO:tasks.ceph:pgid 75.13 last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.154 INFO:tasks.ceph:pgid 75.12 last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.154 INFO:tasks.ceph:pgid 75.11 last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.154 INFO:tasks.ceph:pgid 75.10 last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.154 INFO:tasks.ceph:pgid 75.f last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.154 INFO:tasks.ceph:pgid 75.e last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.154 INFO:tasks.ceph:pgid 75.d last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.154 INFO:tasks.ceph:pgid 75.c last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.154 INFO:tasks.ceph:pgid 75.b last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.154 INFO:tasks.ceph:pgid 75.a last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.155 INFO:tasks.ceph:pgid 75.9 last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.155 INFO:tasks.ceph:pgid 75.8 last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.155 INFO:tasks.ceph:pgid 75.7 last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.155 INFO:tasks.ceph:pgid 75.6 last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.155 INFO:tasks.ceph:pgid 75.5 last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.155 INFO:tasks.ceph:pgid 75.4 last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.155 INFO:tasks.ceph:pgid 75.3 last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.155 INFO:tasks.ceph:pgid 75.2 last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.155 INFO:tasks.ceph:pgid 75.1 last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.155 INFO:tasks.ceph:pgid 75.0 last_scrub_stamp 2024-04-24T01:54:28.682492+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=54, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.156 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-24T01:48:38.975626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=48, tm_sec=38, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.156 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-24T01:48:38.975626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=48, tm_sec=38, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.156 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-24T01:48:38.975626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=48, tm_sec=38, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.156 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-24T01:48:38.975626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=48, tm_sec=38, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.156 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-24T01:48:38.975626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=48, tm_sec=38, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.156 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-24T01:48:38.975626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=48, tm_sec=38, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.156 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-24T01:48:38.975626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=48, tm_sec=38, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.156 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-24T01:48:38.975626+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=48, tm_sec=38, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.156 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-24T01:48:36.956380+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=1, tm_min=48, tm_sec=36, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=2, tm_min=8, tm_sec=13, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T02:08:17.156 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-24T02:08:37.158 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T02:08:37.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.280+0000 7f40ddd5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:37.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.286+0000 7f40ddd5d640 1 Processor -- start 2024-04-24T02:08:37.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.286+0000 7f40ddd5d640 1 -- start start 2024-04-24T02:08:37.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.287+0000 7f40ddd5d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f40d806eb10 0x7f40d81310b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:37.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.287+0000 7f40ddd5d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40d806f870 con 0x7f40d81315f0 2024-04-24T02:08:37.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.287+0000 7f40ddd5d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f40d8130da0 con 0x7f40d806eb10 2024-04-24T02:08:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.287+0000 7f40d77fe640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f40d806eb10 0x7f40d81310b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.287+0000 7f40d6ffd640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f40d81315f0 0x7f40d809b290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:38790/0 (socket says 172.21.15.57:38790) 2024-04-24T02:08:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.287+0000 7f40d6ffd640 1 -- 172.21.15.57:0/2686433449 learned_addr learned my addr 172.21.15.57:0/2686433449 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T02:08:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.288+0000 7f40d67fc640 1 -- 172.21.15.57:0/2686433449 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2725099010 0 0) 0x7f40d806f870 con 0x7f40d81315f0 2024-04-24T02:08:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.288+0000 7f40d67fc640 1 -- 172.21.15.57:0/2686433449 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40c0004690 con 0x7f40d81315f0 2024-04-24T02:08:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.288+0000 7f40d77fe640 1 -- 172.21.15.57:0/2686433449 >> v1:172.21.15.57:6789/0 conn(0x7f40d81315f0 legacy=0x7f40d809b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.288+0000 7f40d77fe640 1 -- 172.21.15.57:0/2686433449 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d806f440 con 0x7f40d806eb10 2024-04-24T02:08:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.288+0000 7f40d77fe640 1 --2- 172.21.15.57:0/2686433449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40d806eb10 0x7f40d81310b0 crc :-1 s=READY pgs=13003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74274275aa5d15da server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.288+0000 7f40d67fc640 1 -- 172.21.15.57:0/2686433449 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f40c8009d90 con 0x7f40d806eb10 2024-04-24T02:08:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.288+0000 7f40d67fc640 1 -- 172.21.15.57:0/2686433449 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f40c800e230 con 0x7f40d806eb10 2024-04-24T02:08:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.288+0000 7f40d67fc640 1 -- 172.21.15.57:0/2686433449 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f40c800e4d0 con 0x7f40d806eb10 2024-04-24T02:08:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.289+0000 7f40ddd5d640 1 -- 172.21.15.57:0/2686433449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40d806eb10 msgr2=0x7f40d81310b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.289+0000 7f40ddd5d640 1 --2- 172.21.15.57:0/2686433449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40d806eb10 0x7f40d81310b0 crc :-1 s=READY pgs=13003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:37.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.289+0000 7f40ddd5d640 1 -- 172.21.15.57:0/2686433449 shutdown_connections 2024-04-24T02:08:37.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.289+0000 7f40ddd5d640 1 --2- 172.21.15.57:0/2686433449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40d806eb10 0x7f40d81310b0 unknown :-1 s=CLOSED pgs=13003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:37.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.289+0000 7f40ddd5d640 1 -- 172.21.15.57:0/2686433449 >> 172.21.15.57:0/2686433449 conn(0x7f40d80a0920 msgr2=0x7f40d80a0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:37.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.289+0000 7f40ddd5d640 1 -- 172.21.15.57:0/2686433449 shutdown_connections 2024-04-24T02:08:37.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.289+0000 7f40ddd5d640 1 -- 172.21.15.57:0/2686433449 wait complete. 2024-04-24T02:08:37.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.289+0000 7f40ddd5d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:37.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.291+0000 7f40ddd5d640 1 Processor -- start 2024-04-24T02:08:37.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.291+0000 7f40ddd5d640 1 -- start start 2024-04-24T02:08:37.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.293+0000 7f40ddd5d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40d806eb10 0x7f40d8137820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:37.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.293+0000 7f40ddd5d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f40d8137360 con 0x7f40d806eb10 2024-04-24T02:08:37.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.293+0000 7f40d77fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40d806eb10 0x7f40d8137820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:37.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.293+0000 7f40d77fe640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40d806eb10 0x7f40d8137820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60454/0 (socket says 172.21.15.57:60454) 2024-04-24T02:08:37.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.293+0000 7f40d77fe640 1 -- 172.21.15.57:0/448147319 learned_addr learned my addr 172.21.15.57:0/448147319 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:08:37.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.293+0000 7f40d77fe640 1 -- 172.21.15.57:0/448147319 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d81191c0 con 0x7f40d806eb10 2024-04-24T02:08:37.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.293+0000 7f40d77fe640 1 --2- 172.21.15.57:0/448147319 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40d806eb10 0x7f40d8137820 crc :-1 s=READY pgs=13004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:37.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.293+0000 7f40bffff640 1 -- 172.21.15.57:0/448147319 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f40c8013400 con 0x7f40d806eb10 2024-04-24T02:08:37.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.294+0000 7f40bffff640 1 -- 172.21.15.57:0/448147319 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f40c8013560 con 0x7f40d806eb10 2024-04-24T02:08:37.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.294+0000 7f40ddd5d640 1 -- 172.21.15.57:0/448147319 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40d8136fc0 con 0x7f40d806eb10 2024-04-24T02:08:37.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.294+0000 7f40bffff640 1 -- 172.21.15.57:0/448147319 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f40c8013800 con 0x7f40d806eb10 2024-04-24T02:08:37.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.294+0000 7f40ddd5d640 1 -- 172.21.15.57:0/448147319 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40d8119680 con 0x7f40d806eb10 2024-04-24T02:08:37.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.295+0000 7f40ddd5d640 1 -- 172.21.15.57:0/448147319 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40d811a600 con 0x7f40d806eb10 2024-04-24T02:08:37.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.295+0000 7f40bffff640 1 -- 172.21.15.57:0/448147319 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f40c80123f0 con 0x7f40d806eb10 2024-04-24T02:08:37.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.295+0000 7f40bffff640 1 --2- 172.21.15.57:0/448147319 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f40c4038980 0x7f40c403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:37.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.295+0000 7f40bffff640 1 -- 172.21.15.57:0/448147319 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(714..714 src has 395..714) ==== 3403+0+0 (crc 0 0 0) 0x7f40c8018040 con 0x7f40d806eb10 2024-04-24T02:08:37.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.295+0000 7f40d6ffd640 1 --2- 172.21.15.57:0/448147319 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f40c4038980 0x7f40c403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:37.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.296+0000 7f40d6ffd640 1 --2- 172.21.15.57:0/448147319 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f40c4038980 0x7f40c403ae90 crc :-1 s=READY pgs=3971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:37.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.300+0000 7f40bffff640 1 -- 172.21.15.57:0/448147319 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f40c8017c00 con 0x7f40d806eb10 2024-04-24T02:08:37.487 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.486+0000 7f40ddd5d640 1 -- 172.21.15.57:0/448147319 --> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f40d811af00 con 0x7f40c4038980 2024-04-24T02:08:37.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.490+0000 7f40bffff640 1 -- 172.21.15.57:0/448147319 <== mgr.4101 v2:172.21.15.84:6800/1747524692 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+109138 (crc 0 0 0) 0x7f40d811af00 con 0x7f40c4038980 2024-04-24T02:08:37.491 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-04-24T02:08:37.492 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-04-24T02:08:37.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.492+0000 7f40ddd5d640 1 -- 172.21.15.57:0/448147319 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f40c4038980 msgr2=0x7f40c403ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:37.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.492+0000 7f40ddd5d640 1 --2- 172.21.15.57:0/448147319 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f40c4038980 0x7f40c403ae90 crc :-1 s=READY pgs=3971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:37.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.492+0000 7f40ddd5d640 1 -- 172.21.15.57:0/448147319 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40d806eb10 msgr2=0x7f40d8137820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:37.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.492+0000 7f40ddd5d640 1 --2- 172.21.15.57:0/448147319 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40d806eb10 0x7f40d8137820 crc :-1 s=READY pgs=13004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:37.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.492+0000 7f40ddd5d640 1 -- 172.21.15.57:0/448147319 shutdown_connections 2024-04-24T02:08:37.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.492+0000 7f40ddd5d640 1 --2- 172.21.15.57:0/448147319 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f40c4038980 0x7f40c403ae90 unknown :-1 s=CLOSED pgs=3971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:37.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.492+0000 7f40ddd5d640 1 --2- 172.21.15.57:0/448147319 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40d806eb10 0x7f40d8137820 unknown :-1 s=CLOSED pgs=13004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:37.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.492+0000 7f40ddd5d640 1 -- 172.21.15.57:0/448147319 >> 172.21.15.57:0/448147319 conn(0x7f40d80a0920 msgr2=0x7f40d809da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:37.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.492+0000 7f40ddd5d640 1 -- 172.21.15.57:0/448147319 shutdown_connections 2024-04-24T02:08:37.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.492+0000 7f40ddd5d640 1 -- 172.21.15.57:0/448147319 wait complete. 2024-04-24T02:08:37.504 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":1308,"stamp":"2024-04-24T02:08:37.202950+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590373,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":109,"num_read_kb":97,"num_write":144,"num_write_kb":1901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":104,"ondisk_log_size":104,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":4,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":419430400,"kb_used":296300,"kb_used_data":14988,"kb_used_omap":0,"kb_used_meta":281280,"kb_avail":419134100,"statfs":{"total":429496729600,"available":429193318400,"internally_reserved":0,"allocated":15347712,"data_stored":6540369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":288030720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003436"},"pg_stats":[{"pgid":"75.1f","version":"0'0","reported_seq":1275,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:15.857554+0000","last_change":"2024-04-24T02:08:15.870893+0000","last_active":"2024-04-24T02:08:15.857554+0000","last_peered":"2024-04-24T02:08:15.857554+0000","last_clean":"2024-04-24T02:08:15.857554+0000","last_became_active":"2024-04-24T01:54:29.899903+0000","last_became_peered":"2024-04-24T01:54:29.899903+0000","last_unstale":"2024-04-24T02:08:15.857554+0000","last_undegraded":"2024-04-24T02:08:15.857554+0000","last_fullsized":"2024-04-24T02:08:15.857554+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:15.870722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:15.870722+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1e","version":"0'0","reported_seq":1277,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:15.385771+0000","last_change":"2024-04-24T02:08:15.399795+0000","last_active":"2024-04-24T02:08:15.385771+0000","last_peered":"2024-04-24T02:08:15.385771+0000","last_clean":"2024-04-24T02:08:15.385771+0000","last_became_active":"2024-04-24T01:54:29.955445+0000","last_became_peered":"2024-04-24T01:54:29.955445+0000","last_unstale":"2024-04-24T02:08:15.385771+0000","last_undegraded":"2024-04-24T02:08:15.385771+0000","last_fullsized":"2024-04-24T02:08:15.385771+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:15.399621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:15.399621+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1d","version":"0'0","reported_seq":1279,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:16.346168+0000","last_change":"2024-04-24T02:08:16.365177+0000","last_active":"2024-04-24T02:08:16.346168+0000","last_peered":"2024-04-24T02:08:16.346168+0000","last_clean":"2024-04-24T02:08:16.346168+0000","last_became_active":"2024-04-24T01:54:29.877273+0000","last_became_peered":"2024-04-24T01:54:29.877273+0000","last_unstale":"2024-04-24T02:08:16.346168+0000","last_undegraded":"2024-04-24T02:08:16.346168+0000","last_fullsized":"2024-04-24T02:08:16.346168+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:16.364969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:16.364969+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.1c","version":"0'0","reported_seq":1243,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:16.838720+0000","last_change":"2024-04-24T02:08:16.865922+0000","last_active":"2024-04-24T02:08:16.838720+0000","last_peered":"2024-04-24T02:08:16.838720+0000","last_clean":"2024-04-24T02:08:16.838720+0000","last_became_active":"2024-04-24T01:54:29.878778+0000","last_became_peered":"2024-04-24T01:54:29.878778+0000","last_unstale":"2024-04-24T02:08:16.838720+0000","last_undegraded":"2024-04-24T02:08:16.838720+0000","last_fullsized":"2024-04-24T02:08:16.838720+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:16.865728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:16.865728+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.1b","version":"0'0","reported_seq":1275,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:15.854107+0000","last_change":"2024-04-24T02:08:15.877575+0000","last_active":"2024-04-24T02:08:15.854107+0000","last_peered":"2024-04-24T02:08:15.854107+0000","last_clean":"2024-04-24T02:08:15.854107+0000","last_became_active":"2024-04-24T01:54:29.938885+0000","last_became_peered":"2024-04-24T01:54:29.938885+0000","last_unstale":"2024-04-24T02:08:15.854107+0000","last_undegraded":"2024-04-24T02:08:15.854107+0000","last_fullsized":"2024-04-24T02:08:15.854107+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:15.877381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:15.877381+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.1a","version":"0'0","reported_seq":1277,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:15.383572+0000","last_change":"2024-04-24T02:08:15.397448+0000","last_active":"2024-04-24T02:08:15.383572+0000","last_peered":"2024-04-24T02:08:15.383572+0000","last_clean":"2024-04-24T02:08:15.383572+0000","last_became_active":"2024-04-24T01:54:29.925475+0000","last_became_peered":"2024-04-24T01:54:29.925475+0000","last_unstale":"2024-04-24T02:08:15.383572+0000","last_undegraded":"2024-04-24T02:08:15.383572+0000","last_fullsized":"2024-04-24T02:08:15.383572+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:15.397143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:15.397143+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.19","version":"0'0","reported_seq":1277,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:15.375584+0000","last_change":"2024-04-24T02:08:15.394470+0000","last_active":"2024-04-24T02:08:15.375584+0000","last_peered":"2024-04-24T02:08:15.375584+0000","last_clean":"2024-04-24T02:08:15.375584+0000","last_became_active":"2024-04-24T01:54:30.002762+0000","last_became_peered":"2024-04-24T01:54:30.002762+0000","last_unstale":"2024-04-24T02:08:15.375584+0000","last_undegraded":"2024-04-24T02:08:15.375584+0000","last_fullsized":"2024-04-24T02:08:15.375584+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:15.394280+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:15.394280+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.18","version":"0'0","reported_seq":1277,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:15.373667+0000","last_change":"2024-04-24T02:08:15.392066+0000","last_active":"2024-04-24T02:08:15.373667+0000","last_peered":"2024-04-24T02:08:15.373667+0000","last_clean":"2024-04-24T02:08:15.373667+0000","last_became_active":"2024-04-24T01:54:29.940930+0000","last_became_peered":"2024-04-24T01:54:29.940930+0000","last_unstale":"2024-04-24T02:08:15.373667+0000","last_undegraded":"2024-04-24T02:08:15.373667+0000","last_fullsized":"2024-04-24T02:08:15.373667+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:15.391739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:15.391739+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.17","version":"0'0","reported_seq":1243,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:16.836627+0000","last_change":"2024-04-24T02:08:16.863471+0000","last_active":"2024-04-24T02:08:16.836627+0000","last_peered":"2024-04-24T02:08:16.836627+0000","last_clean":"2024-04-24T02:08:16.836627+0000","last_became_active":"2024-04-24T01:54:29.915996+0000","last_became_peered":"2024-04-24T01:54:29.915996+0000","last_unstale":"2024-04-24T02:08:16.836627+0000","last_undegraded":"2024-04-24T02:08:16.836627+0000","last_fullsized":"2024-04-24T02:08:16.836627+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:16.863308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:16.863308+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.16","version":"0'0","reported_seq":1279,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:16.342796+0000","last_change":"2024-04-24T02:08:16.363633+0000","last_active":"2024-04-24T02:08:16.342796+0000","last_peered":"2024-04-24T02:08:16.342796+0000","last_clean":"2024-04-24T02:08:16.342796+0000","last_became_active":"2024-04-24T01:54:29.932001+0000","last_became_peered":"2024-04-24T01:54:29.932001+0000","last_unstale":"2024-04-24T02:08:16.342796+0000","last_undegraded":"2024-04-24T02:08:16.342796+0000","last_fullsized":"2024-04-24T02:08:16.342796+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:16.363458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:16.363458+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.15","version":"0'0","reported_seq":1243,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:16.833880+0000","last_change":"2024-04-24T02:08:16.864530+0000","last_active":"2024-04-24T02:08:16.833880+0000","last_peered":"2024-04-24T02:08:16.833880+0000","last_clean":"2024-04-24T02:08:16.833880+0000","last_became_active":"2024-04-24T01:54:29.977785+0000","last_became_peered":"2024-04-24T01:54:29.977785+0000","last_unstale":"2024-04-24T02:08:16.833880+0000","last_undegraded":"2024-04-24T02:08:16.833880+0000","last_fullsized":"2024-04-24T02:08:16.833880+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:16.864363+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:16.864363+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.14","version":"0'0","reported_seq":1277,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:15.370121+0000","last_change":"2024-04-24T02:08:15.404583+0000","last_active":"2024-04-24T02:08:15.370121+0000","last_peered":"2024-04-24T02:08:15.370121+0000","last_clean":"2024-04-24T02:08:15.370121+0000","last_became_active":"2024-04-24T01:54:29.974222+0000","last_became_peered":"2024-04-24T01:54:29.974222+0000","last_unstale":"2024-04-24T02:08:15.370121+0000","last_undegraded":"2024-04-24T02:08:15.370121+0000","last_fullsized":"2024-04-24T02:08:15.370121+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:15.404407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:15.404407+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.13","version":"0'0","reported_seq":1243,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:16.828132+0000","last_change":"2024-04-24T02:08:16.859678+0000","last_active":"2024-04-24T02:08:16.828132+0000","last_peered":"2024-04-24T02:08:16.828132+0000","last_clean":"2024-04-24T02:08:16.828132+0000","last_became_active":"2024-04-24T01:54:30.006792+0000","last_became_peered":"2024-04-24T01:54:30.006792+0000","last_unstale":"2024-04-24T02:08:16.828132+0000","last_undegraded":"2024-04-24T02:08:16.828132+0000","last_fullsized":"2024-04-24T02:08:16.828132+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:16.859515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:16.859515+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.12","version":"0'0","reported_seq":1243,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:16.823265+0000","last_change":"2024-04-24T02:08:16.855295+0000","last_active":"2024-04-24T02:08:16.823265+0000","last_peered":"2024-04-24T02:08:16.823265+0000","last_clean":"2024-04-24T02:08:16.823265+0000","last_became_active":"2024-04-24T01:54:29.921241+0000","last_became_peered":"2024-04-24T01:54:29.921241+0000","last_unstale":"2024-04-24T02:08:16.823265+0000","last_undegraded":"2024-04-24T02:08:16.823265+0000","last_fullsized":"2024-04-24T02:08:16.823265+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:16.855117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:16.855117+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.11","version":"0'0","reported_seq":1277,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:15.364877+0000","last_change":"2024-04-24T02:08:15.403215+0000","last_active":"2024-04-24T02:08:15.364877+0000","last_peered":"2024-04-24T02:08:15.364877+0000","last_clean":"2024-04-24T02:08:15.364877+0000","last_became_active":"2024-04-24T01:54:29.929555+0000","last_became_peered":"2024-04-24T01:54:29.929555+0000","last_unstale":"2024-04-24T02:08:15.364877+0000","last_undegraded":"2024-04-24T02:08:15.364877+0000","last_fullsized":"2024-04-24T02:08:15.364877+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:15.403047+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:15.403047+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.10","version":"0'0","reported_seq":1277,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:15.360575+0000","last_change":"2024-04-24T02:08:15.401409+0000","last_active":"2024-04-24T02:08:15.360575+0000","last_peered":"2024-04-24T02:08:15.360575+0000","last_clean":"2024-04-24T02:08:15.360575+0000","last_became_active":"2024-04-24T01:54:29.949994+0000","last_became_peered":"2024-04-24T01:54:29.949994+0000","last_unstale":"2024-04-24T02:08:15.360575+0000","last_undegraded":"2024-04-24T02:08:15.360575+0000","last_fullsized":"2024-04-24T02:08:15.360575+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:15.401234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:15.401234+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.f","version":"0'0","reported_seq":1277,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:15.357220+0000","last_change":"2024-04-24T02:08:15.380690+0000","last_active":"2024-04-24T02:08:15.357220+0000","last_peered":"2024-04-24T02:08:15.357220+0000","last_clean":"2024-04-24T02:08:15.357220+0000","last_became_active":"2024-04-24T01:54:29.962939+0000","last_became_peered":"2024-04-24T01:54:29.962939+0000","last_unstale":"2024-04-24T02:08:15.357220+0000","last_undegraded":"2024-04-24T02:08:15.357220+0000","last_fullsized":"2024-04-24T02:08:15.357220+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:15.380514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:15.380514+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.e","version":"0'0","reported_seq":1243,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:16.819754+0000","last_change":"2024-04-24T02:08:16.858330+0000","last_active":"2024-04-24T02:08:16.819754+0000","last_peered":"2024-04-24T02:08:16.819754+0000","last_clean":"2024-04-24T02:08:16.819754+0000","last_became_active":"2024-04-24T01:54:29.960381+0000","last_became_peered":"2024-04-24T01:54:29.960381+0000","last_unstale":"2024-04-24T02:08:16.819754+0000","last_undegraded":"2024-04-24T02:08:16.819754+0000","last_fullsized":"2024-04-24T02:08:16.819754+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:16.858164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:16.858164+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.d","version":"0'0","reported_seq":1279,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:16.340565+0000","last_change":"2024-04-24T02:08:16.359910+0000","last_active":"2024-04-24T02:08:16.340565+0000","last_peered":"2024-04-24T02:08:16.340565+0000","last_clean":"2024-04-24T02:08:16.340565+0000","last_became_active":"2024-04-24T01:54:29.874172+0000","last_became_peered":"2024-04-24T01:54:29.874172+0000","last_unstale":"2024-04-24T02:08:16.340565+0000","last_undegraded":"2024-04-24T02:08:16.340565+0000","last_fullsized":"2024-04-24T02:08:16.340565+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:16.359698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:16.359698+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.c","version":"0'0","reported_seq":1275,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:15.850564+0000","last_change":"2024-04-24T02:08:15.874407+0000","last_active":"2024-04-24T02:08:15.850564+0000","last_peered":"2024-04-24T02:08:15.850564+0000","last_clean":"2024-04-24T02:08:15.850564+0000","last_became_active":"2024-04-24T01:54:29.950635+0000","last_became_peered":"2024-04-24T01:54:29.950635+0000","last_unstale":"2024-04-24T02:08:15.850564+0000","last_undegraded":"2024-04-24T02:08:15.850564+0000","last_fullsized":"2024-04-24T02:08:15.850564+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:15.874232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:15.874232+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.b","version":"0'0","reported_seq":1275,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:15.849144+0000","last_change":"2024-04-24T02:08:15.876039+0000","last_active":"2024-04-24T02:08:15.849144+0000","last_peered":"2024-04-24T02:08:15.849144+0000","last_clean":"2024-04-24T02:08:15.849144+0000","last_became_active":"2024-04-24T01:54:29.981633+0000","last_became_peered":"2024-04-24T01:54:29.981633+0000","last_unstale":"2024-04-24T02:08:15.849144+0000","last_undegraded":"2024-04-24T02:08:15.849144+0000","last_fullsized":"2024-04-24T02:08:15.849144+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:15.875855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:15.875855+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.a","version":"0'0","reported_seq":1275,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:15.846986+0000","last_change":"2024-04-24T02:08:15.872449+0000","last_active":"2024-04-24T02:08:15.846986+0000","last_peered":"2024-04-24T02:08:15.846986+0000","last_clean":"2024-04-24T02:08:15.846986+0000","last_became_active":"2024-04-24T01:54:29.963206+0000","last_became_peered":"2024-04-24T01:54:29.963206+0000","last_unstale":"2024-04-24T02:08:15.846986+0000","last_undegraded":"2024-04-24T02:08:15.846986+0000","last_fullsized":"2024-04-24T02:08:15.846986+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:15.872274+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:15.872274+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.9","version":"0'0","reported_seq":1279,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:16.338898+0000","last_change":"2024-04-24T02:08:16.361744+0000","last_active":"2024-04-24T02:08:16.338898+0000","last_peered":"2024-04-24T02:08:16.338898+0000","last_clean":"2024-04-24T02:08:16.338898+0000","last_became_active":"2024-04-24T01:54:29.899615+0000","last_became_peered":"2024-04-24T01:54:29.899615+0000","last_unstale":"2024-04-24T02:08:16.338898+0000","last_undegraded":"2024-04-24T02:08:16.338898+0000","last_fullsized":"2024-04-24T02:08:16.338898+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:16.361564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:16.361564+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"75.8","version":"0'0","reported_seq":1243,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:16.817806+0000","last_change":"2024-04-24T02:08:16.856013+0000","last_active":"2024-04-24T02:08:16.817806+0000","last_peered":"2024-04-24T02:08:16.817806+0000","last_clean":"2024-04-24T02:08:16.817806+0000","last_became_active":"2024-04-24T01:54:29.933820+0000","last_became_peered":"2024-04-24T01:54:29.933820+0000","last_unstale":"2024-04-24T02:08:16.817806+0000","last_undegraded":"2024-04-24T02:08:16.817806+0000","last_fullsized":"2024-04-24T02:08:16.817806+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:16.855812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:16.855812+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.7","version":"0'0","reported_seq":1243,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:16.815972+0000","last_change":"2024-04-24T02:08:16.850830+0000","last_active":"2024-04-24T02:08:16.815972+0000","last_peered":"2024-04-24T02:08:16.815972+0000","last_clean":"2024-04-24T02:08:16.815972+0000","last_became_active":"2024-04-24T01:54:29.897105+0000","last_became_peered":"2024-04-24T01:54:29.897105+0000","last_unstale":"2024-04-24T02:08:16.815972+0000","last_undegraded":"2024-04-24T02:08:16.815972+0000","last_fullsized":"2024-04-24T02:08:16.815972+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:16.850648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:16.850648+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.6","version":"0'0","reported_seq":1277,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:15.355958+0000","last_change":"2024-04-24T02:08:15.377830+0000","last_active":"2024-04-24T02:08:15.355958+0000","last_peered":"2024-04-24T02:08:15.355958+0000","last_clean":"2024-04-24T02:08:15.355958+0000","last_became_active":"2024-04-24T01:54:29.920622+0000","last_became_peered":"2024-04-24T01:54:29.920622+0000","last_unstale":"2024-04-24T02:08:15.355958+0000","last_undegraded":"2024-04-24T02:08:15.355958+0000","last_fullsized":"2024-04-24T02:08:15.355958+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:15.377656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:15.377656+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.5","version":"0'0","reported_seq":1243,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:16.814334+0000","last_change":"2024-04-24T02:08:16.847711+0000","last_active":"2024-04-24T02:08:16.814334+0000","last_peered":"2024-04-24T02:08:16.814334+0000","last_clean":"2024-04-24T02:08:16.814334+0000","last_became_active":"2024-04-24T01:54:29.946732+0000","last_became_peered":"2024-04-24T01:54:29.946732+0000","last_unstale":"2024-04-24T02:08:16.814334+0000","last_undegraded":"2024-04-24T02:08:16.814334+0000","last_fullsized":"2024-04-24T02:08:16.814334+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:16.847527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:16.847527+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"75.4","version":"0'0","reported_seq":1277,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:15.351893+0000","last_change":"2024-04-24T02:08:15.398879+0000","last_active":"2024-04-24T02:08:15.351893+0000","last_peered":"2024-04-24T02:08:15.351893+0000","last_clean":"2024-04-24T02:08:15.351893+0000","last_became_active":"2024-04-24T01:54:30.037754+0000","last_became_peered":"2024-04-24T01:54:30.037754+0000","last_unstale":"2024-04-24T02:08:15.351893+0000","last_undegraded":"2024-04-24T02:08:15.351893+0000","last_fullsized":"2024-04-24T02:08:15.351893+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:15.398697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:15.398697+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.3","version":"0'0","reported_seq":1277,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:15.350454+0000","last_change":"2024-04-24T02:08:15.372353+0000","last_active":"2024-04-24T02:08:15.350454+0000","last_peered":"2024-04-24T02:08:15.350454+0000","last_clean":"2024-04-24T02:08:15.350454+0000","last_became_active":"2024-04-24T01:54:29.904467+0000","last_became_peered":"2024-04-24T01:54:29.904467+0000","last_unstale":"2024-04-24T02:08:15.350454+0000","last_undegraded":"2024-04-24T02:08:15.350454+0000","last_fullsized":"2024-04-24T02:08:15.350454+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:15.372173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:15.372173+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.2","version":"0'0","reported_seq":1277,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:15.349111+0000","last_change":"2024-04-24T02:08:15.387549+0000","last_active":"2024-04-24T02:08:15.349111+0000","last_peered":"2024-04-24T02:08:15.349111+0000","last_clean":"2024-04-24T02:08:15.349111+0000","last_became_active":"2024-04-24T01:54:30.019236+0000","last_became_peered":"2024-04-24T01:54:30.019236+0000","last_unstale":"2024-04-24T02:08:15.349111+0000","last_undegraded":"2024-04-24T02:08:15.349111+0000","last_fullsized":"2024-04-24T02:08:15.349111+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:15.387225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:15.387225+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"75.1","version":"237'7","reported_seq":1288,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:15.845256+0000","last_change":"2024-04-24T02:08:15.869919+0000","last_active":"2024-04-24T02:08:15.845256+0000","last_peered":"2024-04-24T02:08:15.845256+0000","last_clean":"2024-04-24T02:08:15.845256+0000","last_became_active":"2024-04-24T01:54:29.873358+0000","last_became_peered":"2024-04-24T01:54:29.873358+0000","last_unstale":"2024-04-24T02:08:15.845256+0000","last_undegraded":"2024-04-24T02:08:15.845256+0000","last_fullsized":"2024-04-24T02:08:15.845256+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"237'7","last_scrub_stamp":"2024-04-24T02:08:15.869737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:15.869737+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"75.0","version":"0'0","reported_seq":1279,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:16.337261+0000","last_change":"2024-04-24T02:08:16.358141+0000","last_active":"2024-04-24T02:08:16.337261+0000","last_peered":"2024-04-24T02:08:16.337261+0000","last_clean":"2024-04-24T02:08:16.337261+0000","last_became_active":"2024-04-24T01:54:29.909001+0000","last_became_peered":"2024-04-24T01:54:29.909001+0000","last_unstale":"2024-04-24T02:08:16.337261+0000","last_undegraded":"2024-04-24T02:08:16.337261+0000","last_fullsized":"2024-04-24T02:08:16.337261+0000","mapping_epoch":236,"log_start":"0'0","ondisk_log_start":"0'0","created":236,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:16.357953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:16.357953+0000","last_clean_scrub_stamp":"2024-04-24T01:54:28.682492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1865,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:15.844866+0000","last_change":"2024-04-24T02:08:15.869618+0000","last_active":"2024-04-24T02:08:15.844866+0000","last_peered":"2024-04-24T02:08:15.844866+0000","last_clean":"2024-04-24T02:08:15.844866+0000","last_became_active":"2024-04-24T01:48:40.055629+0000","last_became_peered":"2024-04-24T01:48:40.055629+0000","last_unstale":"2024-04-24T02:08:15.844866+0000","last_undegraded":"2024-04-24T02:08:15.844866+0000","last_fullsized":"2024-04-24T02:08:15.844866+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:15.869428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:15.869428+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1869,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:16.337283+0000","last_change":"2024-04-24T02:08:16.356991+0000","last_active":"2024-04-24T02:08:16.337283+0000","last_peered":"2024-04-24T02:08:16.337283+0000","last_clean":"2024-04-24T02:08:16.337283+0000","last_became_active":"2024-04-24T01:48:40.041551+0000","last_became_peered":"2024-04-24T01:48:40.041551+0000","last_unstale":"2024-04-24T02:08:16.337283+0000","last_undegraded":"2024-04-24T02:08:16.337283+0000","last_fullsized":"2024-04-24T02:08:16.337283+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:16.356785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:16.356785+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1849,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:16.814732+0000","last_change":"2024-04-24T02:08:16.847422+0000","last_active":"2024-04-24T02:08:16.814732+0000","last_peered":"2024-04-24T02:08:16.814732+0000","last_clean":"2024-04-24T02:08:16.814732+0000","last_became_active":"2024-04-24T01:48:40.038574+0000","last_became_peered":"2024-04-24T01:48:40.038574+0000","last_unstale":"2024-04-24T02:08:16.814732+0000","last_undegraded":"2024-04-24T02:08:16.814732+0000","last_fullsized":"2024-04-24T02:08:16.814732+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:16.847064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:16.847064+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1869,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:16.335312+0000","last_change":"2024-04-24T02:08:16.356677+0000","last_active":"2024-04-24T02:08:16.335312+0000","last_peered":"2024-04-24T02:08:16.335312+0000","last_clean":"2024-04-24T02:08:16.335312+0000","last_became_active":"2024-04-24T01:48:40.030062+0000","last_became_peered":"2024-04-24T01:48:40.030062+0000","last_unstale":"2024-04-24T02:08:16.335312+0000","last_undegraded":"2024-04-24T02:08:16.335312+0000","last_fullsized":"2024-04-24T02:08:16.335312+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:16.356477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:16.356477+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1875,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:15.350749+0000","last_change":"2024-04-24T02:08:15.363359+0000","last_active":"2024-04-24T02:08:15.350749+0000","last_peered":"2024-04-24T02:08:15.350749+0000","last_clean":"2024-04-24T02:08:15.350749+0000","last_became_active":"2024-04-24T01:48:40.040843+0000","last_became_peered":"2024-04-24T01:48:40.040843+0000","last_unstale":"2024-04-24T02:08:15.350749+0000","last_undegraded":"2024-04-24T02:08:15.350749+0000","last_fullsized":"2024-04-24T02:08:15.350749+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:15.363173+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:15.363173+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1865,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:15.843089+0000","last_change":"2024-04-24T02:08:15.864582+0000","last_active":"2024-04-24T02:08:15.843089+0000","last_peered":"2024-04-24T02:08:15.843089+0000","last_clean":"2024-04-24T02:08:15.843089+0000","last_became_active":"2024-04-24T01:48:40.033297+0000","last_became_peered":"2024-04-24T01:48:40.033297+0000","last_unstale":"2024-04-24T02:08:15.843089+0000","last_undegraded":"2024-04-24T02:08:15.843089+0000","last_fullsized":"2024-04-24T02:08:15.843089+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:15.864386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:15.864386+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1875,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:15.348045+0000","last_change":"2024-04-24T02:08:15.359530+0000","last_active":"2024-04-24T02:08:15.348045+0000","last_peered":"2024-04-24T02:08:15.348045+0000","last_clean":"2024-04-24T02:08:15.348045+0000","last_became_active":"2024-04-24T01:48:40.054792+0000","last_became_peered":"2024-04-24T01:48:40.054792+0000","last_unstale":"2024-04-24T02:08:15.348045+0000","last_undegraded":"2024-04-24T02:08:15.348045+0000","last_fullsized":"2024-04-24T02:08:15.348045+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:15.359325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:15.359325+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1865,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:15.844875+0000","last_change":"2024-04-24T02:08:15.867924+0000","last_active":"2024-04-24T02:08:15.844875+0000","last_peered":"2024-04-24T02:08:15.844875+0000","last_clean":"2024-04-24T02:08:15.844875+0000","last_became_active":"2024-04-24T01:48:40.052084+0000","last_became_peered":"2024-04-24T01:48:40.052084+0000","last_unstale":"2024-04-24T02:08:15.844875+0000","last_undegraded":"2024-04-24T02:08:15.844875+0000","last_fullsized":"2024-04-24T02:08:15.844875+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T02:08:15.867742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:15.867742+0000","last_clean_scrub_stamp":"2024-04-24T01:48:38.975626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'97","reported_seq":1982,"reported_epoch":714,"state":"active+clean","last_fresh":"2024-04-24T02:08:16.812273+0000","last_change":"2024-04-24T02:08:16.861454+0000","last_active":"2024-04-24T02:08:16.812273+0000","last_peered":"2024-04-24T02:08:16.812273+0000","last_clean":"2024-04-24T02:08:16.812273+0000","last_became_active":"2024-04-24T01:48:38.008438+0000","last_became_peered":"2024-04-24T01:48:38.008438+0000","last_unstale":"2024-04-24T02:08:16.812273+0000","last_undegraded":"2024-04-24T02:08:16.812273+0000","last_fullsized":"2024-04-24T02:08:16.812273+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"12'97","last_scrub_stamp":"2024-04-24T02:08:16.861248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T02:08:16.861248+0000","last_clean_scrub_stamp":"2024-04-24T01:48:36.956380+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":75,"num_pg":32,"stat_sum":{"num_bytes":5,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":10,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":1}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654706862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":67056,"kb_used_data":4008,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":104790544,"statfs":{"total":107374182400,"available":107305517056,"internally_reserved":0,"allocated":4104192,"data_stored":1941484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":9,"seq":38654706862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":79012,"kb_used_data":3484,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104778588,"statfs":{"total":107374182400,"available":107293274112,"internally_reserved":0,"allocated":3567616,"data_stored":1332886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":9,"seq":38654706862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":78960,"kb_used_data":3432,"kb_used_omap":0,"kb_used_meta":75520,"kb_avail":104778640,"statfs":{"total":107374182400,"available":107293327360,"internally_reserved":0,"allocated":3514368,"data_stored":1342652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":77332480},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654706862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":104857600,"kb_used":71272,"kb_used_data":4064,"kb_used_omap":0,"kb_used_meta":67200,"kb_avail":104786328,"statfs":{"total":107374182400,"available":107301199872,"internally_reserved":0,"allocated":4161536,"data_stored":1923347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":68812800},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":5,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":75,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T02:08:37.507 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-24T02:08:37.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.611+0000 7f8be479d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:37.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.619+0000 7f8be479d640 1 Processor -- start 2024-04-24T02:08:37.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.619+0000 7f8be479d640 1 -- start start 2024-04-24T02:08:37.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.621+0000 7f8be479d640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8bdc12e610 0x7f8bdc12ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:37.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.621+0000 7f8be479d640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bdc0a25d0 con 0x7f8bdc06e750 2024-04-24T02:08:37.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.621+0000 7f8be479d640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f8bdc0a28e0 con 0x7f8bdc12e610 2024-04-24T02:08:37.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.621+0000 7f8be2539640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8bdc12e610 0x7f8bdc12ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:37.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.621+0000 7f8be1d38640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8bdc06e750 0x7f8bdc06eb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:38798/0 (socket says 172.21.15.57:38798) 2024-04-24T02:08:37.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.621+0000 7f8be1d38640 1 -- 172.21.15.57:0/1977123751 learned_addr learned my addr 172.21.15.57:0/1977123751 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-04-24T02:08:37.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.621+0000 7f8be2539640 1 -- 172.21.15.57:0/1977123751 >> v1:172.21.15.57:6789/0 conn(0x7f8bdc06e750 legacy=0x7f8bdc06eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:37.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.621+0000 7f8be1537640 1 -- 172.21.15.57:0/1977123751 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2360036600 0 0) 0x7f8bdc0a25d0 con 0x7f8bdc06e750 2024-04-24T02:08:37.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.621+0000 7f8be2539640 1 -- 172.21.15.57:0/1977123751 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bdc12ef60 con 0x7f8bdc12e610 2024-04-24T02:08:37.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.622+0000 7f8be2539640 1 --2- 172.21.15.57:0/1977123751 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bdc12e610 0x7f8bdc12ea20 crc :-1 s=READY pgs=13006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84c9c6fca3290e3d server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:37.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.622+0000 7f8be1537640 1 -- 172.21.15.57:0/1977123751 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8bd4009d90 con 0x7f8bdc12e610 2024-04-24T02:08:37.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.622+0000 7f8be1537640 1 -- 172.21.15.57:0/1977123751 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8bd400e230 con 0x7f8bdc12e610 2024-04-24T02:08:37.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.622+0000 7f8be1537640 1 -- 172.21.15.57:0/1977123751 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8bd400e4d0 con 0x7f8bdc12e610 2024-04-24T02:08:37.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.622+0000 7f8be479d640 1 -- 172.21.15.57:0/1977123751 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bdc12e610 msgr2=0x7f8bdc12ea20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:37.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.622+0000 7f8be479d640 1 --2- 172.21.15.57:0/1977123751 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bdc12e610 0x7f8bdc12ea20 crc :-1 s=READY pgs=13006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:37.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.623+0000 7f8be479d640 1 -- 172.21.15.57:0/1977123751 shutdown_connections 2024-04-24T02:08:37.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.623+0000 7f8be479d640 1 --2- 172.21.15.57:0/1977123751 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bdc12e610 0x7f8bdc12ea20 unknown :-1 s=CLOSED pgs=13006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:37.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.623+0000 7f8be479d640 1 -- 172.21.15.57:0/1977123751 >> 172.21.15.57:0/1977123751 conn(0x7f8bdc0a0920 msgr2=0x7f8bdc0a0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:37.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.623+0000 7f8be479d640 1 -- 172.21.15.57:0/1977123751 shutdown_connections 2024-04-24T02:08:37.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.623+0000 7f8be479d640 1 -- 172.21.15.57:0/1977123751 wait complete. 2024-04-24T02:08:37.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.623+0000 7f8be479d640 -1 WARNING: the following dangerous and experimental features are enabled: crimson 2024-04-24T02:08:37.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.625+0000 7f8be479d640 1 Processor -- start 2024-04-24T02:08:37.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.625+0000 7f8be479d640 1 -- start start 2024-04-24T02:08:37.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.626+0000 7f8be479d640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bdc06e750 0x7f8bdc134bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:37.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.626+0000 7f8be479d640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8bdc074f00 con 0x7f8bdc06e750 2024-04-24T02:08:37.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.626+0000 7f8be2539640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bdc06e750 0x7f8bdc134bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:37.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.626+0000 7f8be2539640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bdc06e750 0x7f8bdc134bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:60468/0 (socket says 172.21.15.57:60468) 2024-04-24T02:08:37.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.626+0000 7f8be2539640 1 -- 172.21.15.57:0/821620811 learned_addr learned my addr 172.21.15.57:0/821620811 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-04-24T02:08:37.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.626+0000 7f8be2539640 1 -- 172.21.15.57:0/821620811 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bdc11b370 con 0x7f8bdc06e750 2024-04-24T02:08:37.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.627+0000 7f8be2539640 1 --2- 172.21.15.57:0/821620811 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bdc06e750 0x7f8bdc134bd0 crc :-1 s=READY pgs=13007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:37.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.627+0000 7f8bd2ffd640 1 -- 172.21.15.57:0/821620811 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8bd4013610 con 0x7f8bdc06e750 2024-04-24T02:08:37.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.627+0000 7f8bd2ffd640 1 -- 172.21.15.57:0/821620811 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (crc 0 0 0) 0x7f8bd4013770 con 0x7f8bdc06e750 2024-04-24T02:08:37.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.627+0000 7f8be479d640 1 -- 172.21.15.57:0/821620811 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bdc136620 con 0x7f8bdc06e750 2024-04-24T02:08:37.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.627+0000 7f8bd2ffd640 1 -- 172.21.15.57:0/821620811 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (crc 0 0 0) 0x7f8bd4013a10 con 0x7f8bdc06e750 2024-04-24T02:08:37.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.627+0000 7f8be479d640 1 -- 172.21.15.57:0/821620811 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bdc12e2d0 con 0x7f8bdc06e750 2024-04-24T02:08:37.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.628+0000 7f8be479d640 1 -- 172.21.15.57:0/821620811 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bdc119fb0 con 0x7f8bdc06e750 2024-04-24T02:08:37.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.628+0000 7f8bd2ffd640 1 -- 172.21.15.57:0/821620811 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 45834+0+0 (crc 0 0 0) 0x7f8bd4013bc0 con 0x7f8bdc06e750 2024-04-24T02:08:37.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.628+0000 7f8bd2ffd640 1 --2- 172.21.15.57:0/821620811 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f8bc0038980 0x7f8bc003ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-24T02:08:37.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.628+0000 7f8bd2ffd640 1 -- 172.21.15.57:0/821620811 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(714..714 src has 395..714) ==== 3403+0+0 (crc 0 0 0) 0x7f8bd4018040 con 0x7f8bdc06e750 2024-04-24T02:08:37.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.629+0000 7f8be1d38640 1 --2- 172.21.15.57:0/821620811 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f8bc0038980 0x7f8bc003ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-24T02:08:37.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.629+0000 7f8be1d38640 1 --2- 172.21.15.57:0/821620811 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f8bc0038980 0x7f8bc003ae90 crc :-1 s=READY pgs=3972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-24T02:08:37.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.633+0000 7f8bd2ffd640 1 -- 172.21.15.57:0/821620811 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (crc 0 0 0) 0x7f8bd4018c30 con 0x7f8bdc06e750 2024-04-24T02:08:37.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.821+0000 7f8be479d640 1 -- 172.21.15.57:0/821620811 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f8bdc063900 con 0x7f8bdc06e750 2024-04-24T02:08:37.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.826+0000 7f8bd2ffd640 1 -- 172.21.15.57:0/821620811 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v2)=0 v2) ==== 123+0+0 (crc 0 0 0) 0x7f8bd400f2a0 con 0x7f8bdc06e750 2024-04-24T02:08:37.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.827+0000 7f8bd2ffd640 1 -- 172.21.15.57:0/821620811 <== mon.0 v2:172.21.15.57:3300/0 8 ==== config(1 keys) ==== 35+0+0 (crc 0 0 0) 0x7f8bd4013e70 con 0x7f8bdc06e750 2024-04-24T02:08:37.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.829+0000 7f8be479d640 1 -- 172.21.15.57:0/821620811 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f8bc0038980 msgr2=0x7f8bc003ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:37.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.829+0000 7f8be479d640 1 --2- 172.21.15.57:0/821620811 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f8bc0038980 0x7f8bc003ae90 crc :-1 s=READY pgs=3972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:37.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.829+0000 7f8be479d640 1 -- 172.21.15.57:0/821620811 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bdc06e750 msgr2=0x7f8bdc134bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-24T02:08:37.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.829+0000 7f8be479d640 1 --2- 172.21.15.57:0/821620811 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bdc06e750 0x7f8bdc134bd0 crc :-1 s=READY pgs=13007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:37.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.829+0000 7f8be479d640 1 -- 172.21.15.57:0/821620811 shutdown_connections 2024-04-24T02:08:37.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.829+0000 7f8be479d640 1 --2- 172.21.15.57:0/821620811 >> [v2:172.21.15.84:6800/1747524692,v1:172.21.15.84:6801/1747524692] conn(0x7f8bc0038980 0x7f8bc003ae90 unknown :-1 s=CLOSED pgs=3972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:37.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.829+0000 7f8be479d640 1 --2- 172.21.15.57:0/821620811 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8bdc06e750 0x7f8bdc134bd0 unknown :-1 s=CLOSED pgs=13007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-24T02:08:37.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.829+0000 7f8be479d640 1 -- 172.21.15.57:0/821620811 >> 172.21.15.57:0/821620811 conn(0x7f8bdc0a0920 msgr2=0x7f8bdc137010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-24T02:08:37.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.829+0000 7f8be479d640 1 -- 172.21.15.57:0/821620811 shutdown_connections 2024-04-24T02:08:37.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-04-24T02:08:37.829+0000 7f8be479d640 1 -- 172.21.15.57:0/821620811 wait complete. 2024-04-24T02:08:37.842 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-24T02:08:37.842 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-24T02:08:37.843 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-24T02:08:37.843 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T02:08:37.927 INFO:tasks.ceph.osd.0:Stopped 2024-04-24T02:08:37.927 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-24T02:08:37.927 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T02:08:38.019 INFO:tasks.ceph.osd.1:Stopped 2024-04-24T02:08:38.019 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-24T02:08:38.019 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T02:08:38.099 INFO:tasks.ceph.osd.2:Stopped 2024-04-24T02:08:38.099 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-24T02:08:38.099 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T02:08:38.191 INFO:tasks.ceph.osd.3:Stopped 2024-04-24T02:08:38.192 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-24T02:08:38.192 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-24T02:08:38.192 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T02:08:38.218 INFO:tasks.ceph.mgr.x:Stopped 2024-04-24T02:08:38.219 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-24T02:08:38.219 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-24T02:08:38.219 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T02:08:38.233 INFO:tasks.ceph.mon.a:Stopped 2024-04-24T02:08:38.233 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-24T02:08:38.233 DEBUG:teuthology.orchestra.run.smithi057:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-04-24T02:08:38.307 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi057.front.sepia.ceph.com 2024-04-24T02:08:38.307 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-24T02:08:38.472 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi057.front.sepia.ceph.com 2024-04-24T02:08:38.472 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-24T02:08:38.524 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi084.front.sepia.ceph.com 2024-04-24T02:08:38.524 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-24T02:08:38.755 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi084.front.sepia.ceph.com 2024-04-24T02:08:38.755 DEBUG:teuthology.orchestra.run.smithi084:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-24T02:08:38.856 INFO:tasks.ceph:Archiving mon data... 2024-04-24T02:08:38.857 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yingxin-2024-04-24_01:32:34-crimson-rados-ci-yingxin-crimson-load-obc-new-1-distro-default-smithi/7671128/data/mon.a.tgz 2024-04-24T02:08:38.857 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2024-04-24T02:08:38.873 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.godmDNswKv 2024-04-24T02:08:38.873 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.godmDNswKv 2024-04-24T02:08:39.014 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.godmDNswKv 2024-04-24T02:08:39.096 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.godmDNswKv is 322KB 2024-04-24T02:08:39.193 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.godmDNswKv 2024-04-24T02:08:39.208 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-24T02:08:39.208 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-24T02:08:39.250 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-24T02:08:39.326 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-24T02:08:39.342 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-24T02:08:39.342 INFO:tasks.ceph:Archiving crash dumps... 2024-04-24T02:08:39.343 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/crash to /home/teuthworker/archive/yingxin-2024-04-24_01:32:34-crimson-rados-ci-yingxin-crimson-load-obc-new-1-distro-default-smithi/7671128/remote/smithi057/crash 2024-04-24T02:08:39.344 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-24T02:08:39.390 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/lib/ceph/crash to /home/teuthworker/archive/yingxin-2024-04-24_01:32:34-crimson-rados-ci-yingxin-crimson-load-obc-new-1-distro-default-smithi/7671128/remote/smithi084/crash 2024-04-24T02:08:39.391 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-24T02:08:39.424 INFO:tasks.ceph:Compressing logs... 2024-04-24T02:08:39.424 DEBUG:teuthology.orchestra.run.smithi057:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-24T02:08:39.434 DEBUG:teuthology.orchestra.run.smithi084:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-24T02:08:39.455 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31676.log 2024-04-24T02:08:39.456 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96265.log 2024-04-24T02:08:39.456 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.31676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31714.log 2024-04-24T02:08:39.496 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28100.log 2024-04-24T02:08:39.496 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-24T02:08:39.497 INFO:teuthology.orchestra.run.smithi084.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-24T02:08:39.497 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.28100.log: /var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28020.log 2024-04-24T02:08:39.497 INFO:teuthology.orchestra.run.smithi084.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.28100.log.gz 2024-04-24T02:08:39.497 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28060.log 2024-04-24T02:08:39.497 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.28020.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-24T02:08:39.497 INFO:teuthology.orchestra.run.smithi084.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.28020.log.gz 2024-04-24T02:08:39.497 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-client.admin.28060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27980.log 2024-04-24T02:08:39.497 INFO:teuthology.orchestra.run.smithi084.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.28060.log.gz 2024-04-24T02:08:39.497 INFO:teuthology.orchestra.run.smithi084.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.27980.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.27980.log.gz 2024-04-24T02:08:39.535 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29877.log 2024-04-24T02:08:39.536 INFO:teuthology.orchestra.run.smithi057.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31676.log.gz 2024-04-24T02:08:39.536 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.31714.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.96265.log.gz 2024-04-24T02:08:39.536 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96424.log 2024-04-24T02:08:39.536 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.29877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97354.log 2024-04-24T02:08:39.536 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96424.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.29877.log.gz 2024-04-24T02:08:39.536 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95049.log 2024-04-24T02:08:39.536 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96424.log.gz 2024-04-24T02:08:39.536 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97115.log 2024-04-24T02:08:39.536 INFO:teuthology.orchestra.run.smithi057.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.97354.log.gz 2024-04-24T02:08:39.536 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.95049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96596.log 2024-04-24T02:08:39.536 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96340.log 2024-04-24T02:08:39.536 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95049.log.gz 2024-04-24T02:08:39.536 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96596.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.97115.log.gz 2024-04-24T02:08:39.536 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93806.log 2024-04-24T02:08:39.536 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96596.log.gz 2024-04-24T02:08:39.537 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97066.log 2024-04-24T02:08:39.537 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.93806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94821.log 2024-04-24T02:08:39.537 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96340.log.gz 2024-04-24T02:08:39.537 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96315.log 2024-04-24T02:08:39.537 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93806.log.gz 2024-04-24T02:08:39.537 INFO:teuthology.orchestra.run.smithi057.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.97066.log.gz 2024-04-24T02:08:39.537 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.94821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29607.log 2024-04-24T02:08:39.537 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94734.log 2024-04-24T02:08:39.537 INFO:teuthology.orchestra.run.smithi057.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.96315.log.gz 2024-04-24T02:08:39.537 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.29607.log: gzip -5 --verbose -- 88.6% /var/log/ceph/ceph-client.admin.94738.log 2024-04-24T02:08:39.537 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94821.log.gz 2024-04-24T02:08:39.537 INFO:teuthology.orchestra.run.smithi057.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29607.log.gz 2024-04-24T02:08:39.537 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.94734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29874.log 2024-04-24T02:08:39.538 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.94738.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-24T02:08:39.538 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3%/var/log/ceph/ceph-client.admin.29874.log: -- replaced with /var/log/ceph/ceph-client.admin.94734.log.gz 2024-04-24T02:08:39.538 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94595.log 2024-04-24T02:08:39.538 INFO:teuthology.orchestra.run.smithi057.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.29874.log.gz 2024-04-24T02:08:39.538 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97438.log 2024-04-24T02:08:39.538 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.94738.log.gz 2024-04-24T02:08:39.538 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.94595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94683.log 2024-04-24T02:08:39.538 INFO:teuthology.orchestra.run.smithi057.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.94595.log.gz 2024-04-24T02:08:39.538 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94591.log 2024-04-24T02:08:39.538 INFO:teuthology.orchestra.run.smithi057.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.97438.log.gz 2024-04-24T02:08:39.538 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.94683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96711.log 2024-04-24T02:08:39.538 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31580.log 2024-04-24T02:08:39.538 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.94591.log: 52.0% -- replaced with /var/log/ceph/ceph-client.admin.94591.log.gz 2024-04-24T02:08:39.538 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96711.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-24T02:08:39.539 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94683.log.gz 2024-04-24T02:08:39.539 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96711.log.gz 2024-04-24T02:08:39.539 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.31580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96733.log 2024-04-24T02:08:39.539 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96617.log 2024-04-24T02:08:39.541 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93363.log 2024-04-24T02:08:39.541 INFO:teuthology.orchestra.run.smithi057.stderr: 86.2% 87.8% -- replaced with /var/log/ceph/ceph-client.admin.96733.log.gz 2024-04-24T02:08:39.541 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-04-24T02:08:39.542 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96643.log 2024-04-24T02:08:39.542 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.93363.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.96617.log.gz 2024-04-24T02:08:39.542 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97021.log 2024-04-24T02:08:39.542 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97522.log 2024-04-24T02:08:39.542 INFO:teuthology.orchestra.run.smithi057.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.96643.log.gz 2024-04-24T02:08:39.542 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97021.log: 89.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-24T02:08:39.542 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96403.log 2024-04-24T02:08:39.542 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97522.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.97021.log.gz 2024-04-24T02:08:39.542 INFO:teuthology.orchestra.run.smithi057.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.93691.log 85.4% -- replaced with /var/log/ceph/ceph-client.admin.97522.log.gz 2024-04-24T02:08:39.542 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-04-24T02:08:39.542 INFO:teuthology.orchestra.run.smithi057.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.31580.log.gz 2024-04-24T02:08:39.542 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94572.log 2024-04-24T02:08:39.542 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96403.log.gz 2024-04-24T02:08:39.542 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.93691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96978.log 2024-04-24T02:08:39.543 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.94572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96119.log 2024-04-24T02:08:39.543 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96382.log 2024-04-24T02:08:39.543 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96119.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96978.log.gz 2024-04-24T02:08:39.543 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96529.log 2024-04-24T02:08:39.543 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93844.log 2024-04-24T02:08:39.543 INFO:teuthology.orchestra.run.smithi057.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.94572.log.gz 2024-04-24T02:08:39.543 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28560.log 2024-04-24T02:08:39.543 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96382.log.gz 2024-04-24T02:08:39.543 INFO:teuthology.orchestra.run.smithi057.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.93691.log.gz 2024-04-24T02:08:39.543 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96529.log.gz 2024-04-24T02:08:39.543 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94634.log 2024-04-24T02:08:39.543 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.93844.log: /var/log/ceph/ceph-client.admin.28560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94335.log 2024-04-24T02:08:39.543 INFO:teuthology.orchestra.run.smithi057.stderr: 84.5%/var/log/ceph/ceph-client.admin.94634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96687.log 2024-04-24T02:08:39.543 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28560.log.gz 2024-04-24T02:08:39.544 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.94335.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-24T02:08:39.544 INFO:teuthology.orchestra.run.smithi057.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.93844.log.gz 2024-04-24T02:08:39.544 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96551.log 2024-04-24T02:08:39.544 INFO:teuthology.orchestra.run.smithi057.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.94634.log.gz 2024-04-24T02:08:39.544 INFO:teuthology.orchestra.run.smithi057.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.96687.log.gz 2024-04-24T02:08:39.544 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94819.log 2024-04-24T02:08:39.544 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.96551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93825.log 91.6% -- replaced with /var/log/ceph/ceph-client.admin.94335.log.gz 2024-04-24T02:08:39.544 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-04-24T02:08:39.544 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8%/var/log/ceph/ceph-client.admin.94819.log: -- replaced with /var/log/ceph/ceph-client.admin.96551.log.gz 2024-04-24T02:08:39.544 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-24T02:08:39.544 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.93825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30303.log 2024-04-24T02:08:39.544 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94819.log.gz 2024-04-24T02:08:39.544 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-osd.0.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.93825.log.gz -5 2024-04-24T02:08:39.544 INFO:teuthology.orchestra.run.smithi057.stderr: --verbose -- /var/log/ceph/ceph-client.admin.29707.log 2024-04-24T02:08:39.544 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94736.log 2024-04-24T02:08:39.545 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.30303.log: /var/log/ceph/ceph-client.admin.29707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96957.log 2024-04-24T02:08:39.545 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.94736.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.29707.log.gz 2024-04-24T02:08:39.545 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94998.log 2024-04-24T02:08:39.545 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96957.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94736.log.gz 2024-04-24T02:08:39.545 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96957.log.gz 2024-04-24T02:08:39.545 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96831.log 2024-04-24T02:08:39.545 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.94998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29565.log 2024-04-24T02:08:39.545 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96831.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.94998.log.gz 2024-04-24T02:08:39.545 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96831.log.gz 2024-04-24T02:08:39.545 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97690.log 2024-04-24T02:08:39.545 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94996.log 2024-04-24T02:08:39.545 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.29565.log: /var/log/ceph/ceph-client.admin.97690.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29565.log.gz 2024-04-24T02:08:39.545 INFO:teuthology.orchestra.run.smithi057.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.97690.log.gz 2024-04-24T02:08:39.546 INFO:teuthology.orchestra.run.smithi057.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.96119.log.gz 2024-04-24T02:08:39.546 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29708.log 2024-04-24T02:08:39.546 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.94996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93863.log 2024-04-24T02:08:39.546 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.29708.log: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.93363.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96783.log 2024-04-24T02:08:39.546 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-04-24T02:08:39.546 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% 86.5% -- replaced with /var/log/ceph/ceph-client.admin.29708.log.gz 2024-04-24T02:08:39.546 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94996.log.gz 2024-04-24T02:08:39.546 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94597.log 2024-04-24T02:08:39.546 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.93863.log: /var/log/ceph/ceph-client.admin.96783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96642.log 2024-04-24T02:08:39.546 INFO:teuthology.orchestra.run.smithi057.stderr: 86.0%/var/log/ceph/ceph-client.admin.94597.log: -- replaced with /var/log/ceph/ceph-client.admin.96783.log.gz 2024-04-24T02:08:39.546 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31546.log 2024-04-24T02:08:39.546 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94888.log 2024-04-24T02:08:39.546 INFO:teuthology.orchestra.run.smithi057.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.30303.log.gz 2024-04-24T02:08:39.546 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.31546.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.94597.log.gz 2024-04-24T02:08:39.547 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.96642.log.gz 2024-04-24T02:08:39.547 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-24T02:08:39.547 INFO:teuthology.orchestra.run.smithi057.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.93863.log.gz 2024-04-24T02:08:39.547 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.94888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94684.log 2024-04-24T02:08:39.547 INFO:teuthology.orchestra.run.smithi057.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.94888.log.gz 2024-04-24T02:08:39.547 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.31546.log.gz 2024-04-24T02:08:39.547 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29431.log 2024-04-24T02:08:39.547 INFO:teuthology.orchestra.run.smithi057.stderr:gzip/var/log/ceph/ceph-client.admin.94684.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.95143.log 2024-04-24T02:08:39.547 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.29431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94923.log 2024-04-24T02:08:39.547 INFO:teuthology.orchestra.run.smithi057.stderr: 86.0% 90.7% -- replaced with /var/log/ceph/ceph-client.admin.94684.log.gz 2024-04-24T02:08:39.547 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.95143.log: -- replaced with /var/log/ceph/ceph-client.admin.29431.log.gz 2024-04-24T02:08:39.547 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95708.log 2024-04-24T02:08:39.547 INFO:teuthology.orchestra.run.smithi057.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.95143.log.gz 2024-04-24T02:08:39.547 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.94923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96508.log 2024-04-24T02:08:39.547 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.95708.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94923.log.gz 2024-04-24T02:08:39.548 INFO:teuthology.orchestra.run.smithi057.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.95160.log 2024-04-24T02:08:39.548 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95419.log 2024-04-24T02:08:39.548 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96508.log.gz 2024-04-24T02:08:39.548 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.95160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30772.log 2024-04-24T02:08:39.548 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96087.log 2024-04-24T02:08:39.548 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.30772.log: /var/log/ceph/ceph-client.admin.95419.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.95708.log.gz 2024-04-24T02:08:39.548 INFO:teuthology.orchestra.run.smithi057.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.95160.log.gz 2024-04-24T02:08:39.548 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 92.4% -- replaced with /var/log/ceph/ceph-client.admin.95419.log.gz 2024-04-24T02:08:39.548 INFO:teuthology.orchestra.run.smithi057.stderr: --verbose -- /var/log/ceph/ceph-client.admin.94960.log 2024-04-24T02:08:39.548 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93949.log 2024-04-24T02:08:39.548 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.94960.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.96087.log.gz 2024-04-24T02:08:39.548 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29375.log 2024-04-24T02:08:39.548 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94685.log 2024-04-24T02:08:39.548 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.93949.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.94960.log.gz 2024-04-24T02:08:39.548 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.29375.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.29375.log.gz 2024-04-24T02:08:39.549 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96487.log 2024-04-24T02:08:39.549 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.94685.log: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97480.log 2024-04-24T02:08:39.549 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.93949.log.gz 2024-04-24T02:08:39.549 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29523.log 2024-04-24T02:08:39.549 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94685.log.gz/var/log/ceph/ceph-client.admin.96487.log: 2024-04-24T02:08:39.549 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97480.log: 87.6% 86.5% -- replaced with /var/log/ceph/ceph-client.admin.97480.log.gz 2024-04-24T02:08:39.549 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30027.log 2024-04-24T02:08:39.549 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.29523.log: -- replaced with /var/log/ceph/ceph-client.admin.96487.log.gz 2024-04-24T02:08:39.549 INFO:teuthology.orchestra.run.smithi057.stderr: 85.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94997.log 2024-04-24T02:08:39.549 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29523.log.gz 2024-04-24T02:08:39.549 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.30027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96361.log 2024-04-24T02:08:39.549 INFO:teuthology.orchestra.run.smithi057.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.30027.log.gzgzip 2024-04-24T02:08:39.549 INFO:teuthology.orchestra.run.smithi057.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.93654.log 2024-04-24T02:08:39.549 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.94997.log: /var/log/ceph/ceph-client.admin.96361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94820.log 2024-04-24T02:08:39.549 INFO:teuthology.orchestra.run.smithi057.stderr: 85.5%/var/log/ceph/ceph-client.admin.93654.log: -- replaced with /var/log/ceph/ceph-client.admin.94997.log.gz 2024-04-24T02:08:39.550 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96361.log.gz 2024-04-24T02:08:39.550 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97396.log 2024-04-24T02:08:39.550 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.94820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96915.log 2024-04-24T02:08:39.550 INFO:teuthology.orchestra.run.smithi057.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.93654.log.gz 2024-04-24T02:08:39.550 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97396.log: 90.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.94820.log.gz 2024-04-24T02:08:39.550 INFO:teuthology.orchestra.run.smithi057.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.31695.log 2024-04-24T02:08:39.550 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96915.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.25975.log 2024-04-24T02:08:39.550 INFO:teuthology.orchestra.run.smithi057.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.97396.log.gz 2024-04-24T02:08:39.550 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.31695.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96915.log.gz 2024-04-24T02:08:39.550 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97814.log 2024-04-24T02:08:39.550 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph.tmp-client.admin.25975.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31695.log.gz 2024-04-24T02:08:39.550 INFO:teuthology.orchestra.run.smithi057.stderr: 67.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94633.log 2024-04-24T02:08:39.550 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph.tmp-client.admin.25975.log.gz 2024-04-24T02:08:39.550 INFO:teuthology.orchestra.run.smithi057.stderr:gzip/var/log/ceph/ceph-client.admin.97814.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.94596.log 2024-04-24T02:08:39.551 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.94633.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.97814.log.gz 2024-04-24T02:08:39.551 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95372.log 2024-04-24T02:08:39.551 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.94596.log: 90.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31638.log 2024-04-24T02:08:39.551 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94633.log.gz 2024-04-24T02:08:39.551 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.95372.log: gzip -5 --verbose 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94596.log.gz 2024-04-24T02:08:39.551 INFO:teuthology.orchestra.run.smithi057.stderr: -- 93.2% -- replaced with /var/log/ceph/ceph-client.admin.30772.log.gz 2024-04-24T02:08:39.551 INFO:teuthology.orchestra.run.smithi057.stderr: /var/log/ceph/ceph-client.admin.96445.log 2024-04-24T02:08:39.551 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.31638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94444.log 2024-04-24T02:08:39.551 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95920.log 2024-04-24T02:08:39.551 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.94444.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96445.log.gz 2024-04-24T02:08:39.551 INFO:teuthology.orchestra.run.smithi057.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.95372.log.gz 2024-04-24T02:08:39.551 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97606.log 2024-04-24T02:08:39.551 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.95920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29985.log 2024-04-24T02:08:39.552 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97606.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.97606.log.gz 2024-04-24T02:08:39.552 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28531.log 2024-04-24T02:08:39.552 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.29985.log: 94.1% 85.4% -- replaced with /var/log/ceph/ceph-client.admin.29985.log.gz 2024-04-24T02:08:39.552 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31638.log.gz 2024-04-24T02:08:39.552 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96936.log 2024-04-24T02:08:39.552 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.28531.log: gzip -5 91.5% -- replaced with /var/log/ceph/ceph-client.admin.95920.log.gz 2024-04-24T02:08:39.552 INFO:teuthology.orchestra.run.smithi057.stderr: --verbose -- /var/log/ceph/ceph-client.admin.31599.log 84.7% -- replaced with /var/log/ceph/ceph-client.admin.28531.log.gz 2024-04-24T02:08:39.552 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-04-24T02:08:39.552 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95601.log 2024-04-24T02:08:39.552 INFO:teuthology.orchestra.run.smithi057.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.94444.log.gz 2024-04-24T02:08:39.552 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96936.log.gz 2024-04-24T02:08:39.552 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.31599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29481.log 2024-04-24T02:08:39.552 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.95601.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.31599.log.gz 2024-04-24T02:08:39.552 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96466.log 2024-04-24T02:08:39.552 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.29481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94961.log 2024-04-24T02:08:39.553 INFO:teuthology.orchestra.run.smithi057.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.29481.log.gz/var/log/ceph/ceph-client.admin.96466.log: 2024-04-24T02:08:39.553 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94632.log 2024-04-24T02:08:39.553 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.96466.log.gz 2024-04-24T02:08:39.553 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.94961.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.95601.log.gz 2024-04-24T02:08:39.553 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96810.log 2024-04-24T02:08:39.553 INFO:teuthology.orchestra.run.smithi057.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.94961.log.gz 2024-04-24T02:08:39.553 INFO:teuthology.orchestra.run.smithi057.stderr:gzip/var/log/ceph/ceph-client.admin.94632.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.96894.log 2024-04-24T02:08:39.553 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95081.log 2024-04-24T02:08:39.553 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.96810.log.gz 2024-04-24T02:08:39.553 INFO:teuthology.orchestra.run.smithi057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94632.log.gz 2024-04-24T02:08:39.553 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94924.log 2024-04-24T02:08:39.553 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96894.log.gz 2024-04-24T02:08:39.553 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.95081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93882.log 2024-04-24T02:08:39.553 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.94924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93473.log 2024-04-24T02:08:39.554 INFO:teuthology.orchestra.run.smithi057.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.94924.log.gz 2024-04-24T02:08:39.554 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.93882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97774.log 2024-04-24T02:08:39.554 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.93473.log: 90.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97648.log 2024-04-24T02:08:39.554 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95081.log.gz 2024-04-24T02:08:39.554 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97042.log 2024-04-24T02:08:39.554 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97774.log: /var/log/ceph/ceph-client.admin.97648.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.97774.log.gz 86.4% 2024-04-24T02:08:39.554 INFO:teuthology.orchestra.run.smithi057.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.93882.log.gz 2024-04-24T02:08:39.554 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.97648.log.gz 2024-04-24T02:08:39.554 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94735.log 2024-04-24T02:08:39.554 INFO:teuthology.orchestra.run.smithi057.stderr: 91.9%/var/log/ceph/ceph-client.admin.97042.log: -- replaced with /var/log/ceph/ceph-client.admin.93473.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96999.log 2024-04-24T02:08:39.554 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-04-24T02:08:39.554 INFO:teuthology.orchestra.run.smithi057.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.97042.log.gz 2024-04-24T02:08:39.554 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.94735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97732.log 2024-04-24T02:08:39.554 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97270.log 2024-04-24T02:08:39.554 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0%/var/log/ceph/ceph-client.admin.96999.log: -- replaced with /var/log/ceph/ceph-client.admin.94735.log.gz 2024-04-24T02:08:39.555 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96873.log 2024-04-24T02:08:39.555 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97732.log: /var/log/ceph/ceph-client.admin.97270.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.96999.log.gz 2024-04-24T02:08:39.555 INFO:teuthology.orchestra.run.smithi057.stderr:gzip 85.3% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.97732.log.gz -- 2024-04-24T02:08:39.555 INFO:teuthology.orchestra.run.smithi057.stderr: /var/log/ceph/ceph-client.admin.97312.log 2024-04-24T02:08:39.555 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96873.log: 85.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93435.log 2024-04-24T02:08:39.555 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.97270.log.gz 2024-04-24T02:08:39.555 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.97312.log: gzip -5 87.7% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.96873.log.gz /var/log/ceph/ceph-client.admin.94887.log 2024-04-24T02:08:39.555 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-04-24T02:08:39.555 INFO:teuthology.orchestra.run.smithi057.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.97312.log.gz 2024-04-24T02:08:39.555 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96759.log 2024-04-24T02:08:39.555 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.93435.log: gzip/var/log/ceph/ceph-client.admin.94887.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.96852.log 2024-04-24T02:08:39.555 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96759.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93435.log.gz 2024-04-24T02:08:39.555 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96291.log 2024-04-24T02:08:39.555 INFO:teuthology.orchestra.run.smithi057.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.96759.log.gz 2024-04-24T02:08:39.555 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.94887.log.gz 2024-04-24T02:08:39.556 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97091.log 2024-04-24T02:08:39.556 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96852.log.gz 2024-04-24T02:08:39.556 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94737.log 2024-04-24T02:08:39.556 INFO:teuthology.orchestra.run.smithi057.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.96291.log.gz 2024-04-24T02:08:39.556 INFO:teuthology.orchestra.run.smithi057.stderr:gzip/var/log/ceph/ceph-client.admin.97091.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.30069.log 2024-04-24T02:08:39.556 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.94737.log: 86.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29875.log 2024-04-24T02:08:39.556 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.97091.log.gz 2024-04-24T02:08:39.556 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.30069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97228.log 2024-04-24T02:08:39.556 INFO:teuthology.orchestra.run.smithi057.stderr: 85.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28375.log 2024-04-24T02:08:39.556 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30069.log.gz 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94737.log.gz 2024-04-24T02:08:39.556 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-04-24T02:08:39.556 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.29875.log: /var/log/ceph/ceph-client.admin.97228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29706.log 2024-04-24T02:08:39.556 INFO:teuthology.orchestra.run.smithi057.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.29875.log.gz 2024-04-24T02:08:39.556 INFO:teuthology.orchestra.run.smithi057.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.97228.log.gz/var/log/ceph/ceph-client.admin.28375.log: 2024-04-24T02:08:39.556 INFO:teuthology.orchestra.run.smithi057.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.28375.log.gz 2024-04-24T02:08:39.557 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28296.log 2024-04-24T02:08:39.557 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29876.log 2024-04-24T02:08:39.557 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.29706.log: /var/log/ceph/ceph-client.admin.28296.log: gzip 86.8% -- replaced with /var/log/ceph/ceph-client.admin.29706.log.gz 2024-04-24T02:08:39.557 INFO:teuthology.orchestra.run.smithi057.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.96552.log 2024-04-24T02:08:39.557 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.29876.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.28296.log.gz 2024-04-24T02:08:39.557 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29709.log 2024-04-24T02:08:39.557 INFO:teuthology.orchestra.run.smithi057.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.29876.log.gz 2024-04-24T02:08:39.557 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.96552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97564.log 2024-04-24T02:08:39.557 INFO:teuthology.orchestra.run.smithi057.stderr:gzip 86.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.96552.log.gz --verbose 2024-04-24T02:08:39.557 INFO:teuthology.orchestra.run.smithi057.stderr: -- /var/log/ceph/ceph-client.admin.94000.log 2024-04-24T02:08:39.557 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.29709.log: /var/log/ceph/ceph-client.admin.97564.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.29709.log.gz 2024-04-24T02:08:39.557 INFO:teuthology.orchestra.run.smithi057.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.97564.log.gz 2024-04-24T02:08:39.557 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.94000.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.94000.log.gz 2024-04-24T02:08:39.706 INFO:teuthology.orchestra.run.smithi084.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-24T02:08:39.897 INFO:teuthology.orchestra.run.smithi057.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.31714.log.gz 2024-04-24T02:08:41.019 INFO:teuthology.orchestra.run.smithi057.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-24T02:08:44.255 INFO:teuthology.orchestra.run.smithi084.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-24T02:08:44.565 INFO:teuthology.orchestra.run.smithi057.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-24T02:08:44.607 INFO:teuthology.orchestra.run.smithi084.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-24T02:08:44.609 INFO:teuthology.orchestra.run.smithi084.stderr: 2024-04-24T02:08:44.609 INFO:teuthology.orchestra.run.smithi084.stderr:real 0m5.126s 2024-04-24T02:08:44.609 INFO:teuthology.orchestra.run.smithi084.stderr:user 0m9.677s 2024-04-24T02:08:44.609 INFO:teuthology.orchestra.run.smithi084.stderr:sys 0m0.419s 2024-04-24T02:08:45.107 INFO:teuthology.orchestra.run.smithi057.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-24T02:08:45.109 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-04-24T02:08:45.109 INFO:teuthology.orchestra.run.smithi057.stderr:real 0m5.662s 2024-04-24T02:08:45.109 INFO:teuthology.orchestra.run.smithi057.stderr:user 0m12.388s 2024-04-24T02:08:45.109 INFO:teuthology.orchestra.run.smithi057.stderr:sys 0m0.564s 2024-04-24T02:08:45.109 INFO:tasks.ceph:Archiving logs... 2024-04-24T02:08:45.109 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/log/ceph to /home/teuthworker/archive/yingxin-2024-04-24_01:32:34-crimson-rados-ci-yingxin-crimson-load-obc-new-1-distro-default-smithi/7671128/remote/smithi057/log 2024-04-24T02:08:45.110 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-24T02:08:47.160 DEBUG:teuthology.misc:Transferring archived files from smithi084:/var/log/ceph to /home/teuthworker/archive/yingxin-2024-04-24_01:32:34-crimson-rados-ci-yingxin-crimson-load-obc-new-1-distro-default-smithi/7671128/remote/smithi084/log 2024-04-24T02:08:47.161 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-24T02:08:48.715 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-24T02:08:48.725 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-24T02:08:48.725 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-24T02:08:48.728 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-24T02:08:48.826 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-24T02:08:48.834 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-24T02:08:48.835 DEBUG:teuthology.orchestra.run.smithi057:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T02:08:48.837 DEBUG:teuthology.orchestra.run.smithi084:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T02:08:48.852 INFO:teuthology.orchestra.run.smithi057.stderr:bash: line 1: ntpq: command not found 2024-04-24T02:08:48.853 INFO:teuthology.orchestra.run.smithi084.stderr:bash: line 1: ntpq: command not found 2024-04-24T02:08:48.856 INFO:teuthology.orchestra.run.smithi057.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-24T02:08:48.856 INFO:teuthology.orchestra.run.smithi057.stdout:=============================================================================== 2024-04-24T02:08:48.856 INFO:teuthology.orchestra.run.smithi057.stdout:^- hv01.front.sepia.ceph.com 2 6 377 27 +1325us[+1330us] +/- 589ms 2024-04-24T02:08:48.856 INFO:teuthology.orchestra.run.smithi057.stdout:^* hv02.front.sepia.ceph.com 3 6 377 26 -627us[ -622us] +/- 68ms 2024-04-24T02:08:48.856 INFO:teuthology.orchestra.run.smithi057.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 28 +787us[ +792us] +/- 79ms 2024-04-24T02:08:48.856 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T02:08:48.858 INFO:teuthology.orchestra.run.smithi084.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-24T02:08:48.858 INFO:teuthology.orchestra.run.smithi084.stdout:=============================================================================== 2024-04-24T02:08:48.858 INFO:teuthology.orchestra.run.smithi084.stdout:^- hv01.front.sepia.ceph.com 2 6 377 26 +1316us[+1316us] +/- 589ms 2024-04-24T02:08:48.858 INFO:teuthology.orchestra.run.smithi084.stdout:^* hv02.front.sepia.ceph.com 3 6 377 27 -638us[ -639us] +/- 68ms 2024-04-24T02:08:48.858 INFO:teuthology.orchestra.run.smithi084.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 +762us[ +761us] +/- 79ms 2024-04-24T02:08:48.858 INFO:teuthology.orchestra.run.smithi084.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-24T02:08:48.860 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-24T02:08:48.872 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-24T02:08:48.873 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-24T02:08:48.881 DEBUG:teuthology.orchestra.run.smithi057:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-24T02:08:48.963 DEBUG:teuthology.orchestra.run.smithi084:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-24T02:08:49.024 DEBUG:teuthology.orchestra.run.smithi057:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-24T02:08:49.053 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T02:08:49.053 DEBUG:teuthology.orchestra.run.smithi084:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-24T02:08:49.081 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T02:08:49.081 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-24T02:08:49.091 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-24T02:08:49.099 INFO:teuthology.task.internal:Duration was 1669.859522 seconds 2024-04-24T02:08:49.099 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-24T02:08:49.108 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-24T02:08:49.108 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-24T02:08:49.111 DEBUG:teuthology.orchestra.run.smithi084:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-24T02:08:49.149 INFO:teuthology.orchestra.run.smithi057.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-24T02:08:49.159 INFO:teuthology.orchestra.run.smithi084.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-24T02:08:49.483 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-24T02:08:49.483 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi057.front.sepia.ceph.com 2024-04-24T02:08:49.484 DEBUG:teuthology.orchestra.run.smithi057:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-24T02:08:49.507 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi084.front.sepia.ceph.com 2024-04-24T02:08:49.508 DEBUG:teuthology.orchestra.run.smithi084:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-24T02:08:49.562 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-24T02:08:49.562 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-24T02:08:49.564 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-24T02:08:49.630 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-24T02:08:49.630 DEBUG:teuthology.orchestra.run.smithi057:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-24T02:08:49.634 DEBUG:teuthology.orchestra.run.smithi084:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-24T02:08:49.765 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-24T02:08:49.780 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-24T02:08:49.781 DEBUG:teuthology.orchestra.run.smithi057:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-24T02:08:49.806 DEBUG:teuthology.orchestra.run.smithi084:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-24T02:08:49.829 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-24T02:08:49.839 DEBUG:teuthology.orchestra.run.smithi057:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-24T02:08:49.848 DEBUG:teuthology.orchestra.run.smithi084:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-24T02:08:49.869 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = core 2024-04-24T02:08:49.891 INFO:teuthology.orchestra.run.smithi084.stdout:kernel.core_pattern = core 2024-04-24T02:08:49.928 DEBUG:teuthology.orchestra.run.smithi057:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-24T02:08:49.942 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T02:08:49.942 DEBUG:teuthology.orchestra.run.smithi084:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-24T02:08:49.982 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T02:08:49.982 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-24T02:08:49.994 INFO:teuthology.task.internal:Transferring archived files... 2024-04-24T02:08:49.995 DEBUG:teuthology.misc:Transferring archived files from smithi057:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yingxin-2024-04-24_01:32:34-crimson-rados-ci-yingxin-crimson-load-obc-new-1-distro-default-smithi/7671128/remote/smithi057 2024-04-24T02:08:49.995 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-24T02:08:50.028 DEBUG:teuthology.misc:Transferring archived files from smithi084:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yingxin-2024-04-24_01:32:34-crimson-rados-ci-yingxin-crimson-load-obc-new-1-distro-default-smithi/7671128/remote/smithi084 2024-04-24T02:08:50.028 DEBUG:teuthology.orchestra.run.smithi084:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-24T02:08:50.060 INFO:teuthology.task.internal:Removing archive directory... 2024-04-24T02:08:50.060 DEBUG:teuthology.orchestra.run.smithi057:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-24T02:08:50.065 DEBUG:teuthology.orchestra.run.smithi084:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-24T02:08:50.109 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-24T02:08:50.120 INFO:teuthology.task.internal:Not uploading archives. 2024-04-24T02:08:50.120 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-24T02:08:50.130 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-24T02:08:50.130 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-24T02:08:50.132 DEBUG:teuthology.orchestra.run.smithi084:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-24T02:08:50.145 INFO:teuthology.orchestra.run.smithi057.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 24 02:08 /home/ubuntu/cephtest 2024-04-24T02:08:50.162 INFO:teuthology.orchestra.run.smithi084.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 24 02:08 /home/ubuntu/cephtest 2024-04-24T02:08:50.163 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-24T02:08:50.174 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-24T02:08:50.200 INFO:teuthology.run:Summary data: description: crimson-rados/basic/{clusters/fixed-2 crimson-supported-all-distro/centos_latest crimson_qa_overrides deploy/ceph tasks/rados_api_tests} duration: 1669.8595216274261 flavor: crimson owner: scheduled_yingxin@teuthology success: true 2024-04-24T02:08:50.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-24T02:08:50.296 INFO:teuthology.run:pass